-- Logs begin at Thu 2022-09-01 15:37:54 UTC, end at Thu 2022-09-01 17:02:45 UTC. -- Sep 01 16:24:03.909089 dv-cinder-836027-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 16:24:03.917733 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:24:03 2022] *** Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: nodename: dv-cinder-836027-9-iscsi Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: machine: x86_64 Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: clock source: unix Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: pcre jit disabled Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: detected number of CPU cores: 4 Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: current working directory: / Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: your processes number limit is 47680 Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: your memory page size is 4096 bytes Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: detected max file descriptor number: 2048 Sep 01 16:24:03.919762 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: lock engine: pthread robust mutexes Sep 01 16:24:03.920565 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: thunder lock: enabled Sep 01 16:24:03.920565 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 16:24:03.920565 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:24:03.959255 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: Python main interpreter initialized at 0x55dc43a6f9c0 Sep 01 16:24:03.959255 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: python threads support enabled Sep 01 16:24:03.959255 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: your server socket listen backlog is limited to 100 connections Sep 01 16:24:03.959255 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:24:03.959631 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:24:03.959707 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: *** Operational MODE: preforking *** Sep 01 16:24:03.959936 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:24:03.959936 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: spawned uWSGI master process (pid: 105875) Sep 01 16:24:03.960137 dv-cinder-836027-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 16:24:03.960692 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: spawned uWSGI worker 1 (pid: 105876, cores: 1) Sep 01 16:24:03.961028 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: spawned uWSGI worker 2 (pid: 105877, cores: 1) Sep 01 16:24:03.963440 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:24:04.624720 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:24:04.642864 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:24:05.715011 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:24:05.715011 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: from cryptography.utils import int_from_bytes Sep 01 16:24:05.715651 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:24:05.715651 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: from cryptography.utils import int_from_bytes Sep 01 16:24:05.746767 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:24:05.746767 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: from cryptography.utils import int_from_bytes Sep 01 16:24:05.747298 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:24:05.747298 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: from cryptography.utils import int_from_bytes Sep 01 16:24:08.217544 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:24:08.218419 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:24:08.218419 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:24:08.218656 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:24:08.218915 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:24:08.219342 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.233461 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.233461 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.233461 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.233461 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.233461 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.233461 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.233461 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.233461 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234006 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234006 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234006 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-9-iscsi {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234006 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234006 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234006 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234006 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234006 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234478 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234478 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234478 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234478 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234478 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234478 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234849 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234849 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234849 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234849 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234849 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234849 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.234849 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.235316 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:24:08.235692 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-9-iscsi {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.235777 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:24:08.235845 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.235845 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.235960 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:24:08.236041 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236106 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:24:08.236184 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236258 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:24:08.236331 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236403 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236475 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236553 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236626 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236697 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236774 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236840 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236912 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.236986 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237058 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237135 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237202 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237267 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237339 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237414 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237480 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237551 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237617 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237687 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237761 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237828 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237892 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.237956 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-9-iscsi {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238026 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238091 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238166 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238247 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238331 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238398 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238468 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238546 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238620 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238686 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238767 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238850 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238917 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.238982 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239046 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239046 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239226 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239320 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239395 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239461 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239526 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239595 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239671 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239767 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239858 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239929 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.239995 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240059 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240206 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240271 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240334 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240406 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240493 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240562 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240627 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240690 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240766 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240766 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.240894 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-9-iscsi {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.241801 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.241922 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.241922 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.242129 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.242243 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.242361 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.242361 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.242601 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.242601 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.242930 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.242930 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.243327 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.243446 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.243587 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.243784 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.243923 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.244058 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.244185 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.244311 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.244436 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.244576 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.244703 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.244846 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.244986 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.245115 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.245240 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.245374 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.245507 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.245644 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.245769 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.245894 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.246019 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.246154 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.246289 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.246423 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.246549 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.246674 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.246799 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.247511 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.247598 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.247690 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.247772 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.247859 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248009 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248094 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248173 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248250 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248328 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248417 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248498 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248608 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248698 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.248914 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.249004 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.249220 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.249318 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.249526 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.249615 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.249831 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.249979 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.250137 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.250233 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.250442 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.250530 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.250747 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.250850 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.251051 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.251184 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.251381 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.251475 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.251687 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.251784 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.252009 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.252103 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.252331 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.252428 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.252656 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.252746 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.252960 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.253054 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.253264 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.253361 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.253569 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.253665 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.253889 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.253986 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.254197 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.254293 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.254503 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.254601 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.254822 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.254920 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.255130 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.255239 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.255457 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.255548 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.255775 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.255863 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.256082 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.256171 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.256389 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.256525 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.256702 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.256825 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.257004 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.257119 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.257311 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.257437 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.257629 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.257756 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.257865 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.257971 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.258759 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.259050 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.259187 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.259300 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.259439 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.259576 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.259754 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.259886 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.260130 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.260278 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.260406 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.260545 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.260671 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.260807 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.260945 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.261120 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.261251 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.261386 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.261551 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.261690 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.261860 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.261990 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.262175 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.262314 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.262484 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.262623 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.262792 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.262925 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.263103 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.263327 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.263438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.263528 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.263749 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.263837 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.264072 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.264162 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.264395 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.264483 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.264704 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.264794 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.265013 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.265104 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.265320 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.265410 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.265628 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.265724 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.265952 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.266043 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.266262 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.266351 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.266570 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.266657 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.266879 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.266975 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.267212 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.267345 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.267524 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.267634 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.267845 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.267941 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.268155 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.268252 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.268462 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.268565 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.268776 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.268876 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.269078 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.269195 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.269386 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.269491 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.269705 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.269791 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.270014 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.270099 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.270323 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.270422 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.270629 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.270716 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.270936 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.271023 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.271265 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.271354 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.271576 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.271661 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.271883 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.271980 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.272199 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.272286 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.272501 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.272592 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.272822 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.272922 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.273150 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.273324 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.273472 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.273610 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.273795 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.274483 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.274792 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.274940 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.275072 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:24:08.275241 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.275374 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.275512 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.275617 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.275707 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.275941 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.276031 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.276251 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.276345 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.276564 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.276662 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.276877 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.276974 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.277216 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.277303 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.277535 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.277626 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.277855 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.277952 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.278170 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.278265 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.278481 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.278580 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.278794 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.278888 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.279103 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.279239 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.279439 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.279529 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.279750 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.279845 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.280057 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.280155 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.280366 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.280475 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.280672 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.280768 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.280983 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.281083 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.281289 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.281375 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.281606 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.281692 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.281929 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.282016 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.282235 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.282320 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.282554 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.282639 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.282864 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.282949 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.283192 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.283299 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.283511 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.283624 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.283820 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.283910 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.284127 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.284213 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.284440 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.284541 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.284752 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.284857 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.285056 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.285143 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.285378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.285473 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.285692 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.285785 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.285997 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.286083 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.286320 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.286415 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.286628 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.286722 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.286937 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.287024 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.287279 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.287385 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.287593 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.287690 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.287906 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.287992 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.288219 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.288313 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.288529 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.288614 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.288855 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.288948 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.289169 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.289257 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.289563 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.289688 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.289924 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.290012 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.290240 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.290360 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.290566 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.290667 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.290881 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.290987 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.291227 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.291342 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.291544 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.291662 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.291856 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.291954 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.292173 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.292261 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.292485 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.292578 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.292800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.292894 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.293109 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.293195 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.293430 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.293529 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.293736 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.293846 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.294040 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.294135 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.294345 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.294432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.294650 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.294760 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.294956 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.295053 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.295299 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.295390 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.295611 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.295715 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.295919 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.296012 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.296222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.296307 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.296526 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.296620 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.296832 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.296916 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.297158 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.297286 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.297474 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.297648 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.297782 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.297986 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.298107 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.298308 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.298402 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.298632 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.298732 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.298946 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.299031 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.299293 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.299398 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.299610 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.299697 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.299925 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.300011 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.300239 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.300333 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.300551 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.300638 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.300864 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.300956 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.301175 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.301260 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.301495 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.301581 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.301808 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.301893 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.302126 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.302219 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.302436 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.302527 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.302756 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.302842 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.303062 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.303176 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.303394 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.303478 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.303727 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.303857 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.304018 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.304106 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.304325 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.304419 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.304633 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.304727 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.304961 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.305112 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.305276 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.305502 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.305590 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.305677 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.305879 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.305966 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.306185 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.306271 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.306493 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.306589 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.306820 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.306915 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.307136 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.307248 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.307466 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.307566 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.307791 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.307878 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.308083 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.308170 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.308404 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.308489 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.308719 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.308812 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.309024 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.309109 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.309340 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.309427 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.309667 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.309753 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.310002 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.310088 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.310315 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.310402 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.310626 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.310762 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.310937 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.311047 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.311271 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.311359 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.311583 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.311670 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.311895 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.312002 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.312203 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.312289 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.312512 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.312600 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.312823 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.312923 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.313133 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.313235 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.313442 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.313527 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.313754 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.313853 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.314060 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.314148 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.314365 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.314451 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.314675 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.314768 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.314982 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.315068 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.315313 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.315410 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.315621 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.315724 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.315943 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.316038 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.316253 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.316345 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.316575 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.316665 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.316887 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.316978 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.317189 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.317273 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.317500 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.317592 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.317813 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.317898 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.318121 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.318214 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.318426 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.318766 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.318988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.319075 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.319315 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.319415 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.319639 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.319725 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.319954 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.320047 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.320257 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.320351 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.321082 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.321175 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.321416 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.321510 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.321727 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.321820 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.322042 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.322158 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.322355 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.322481 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.322665 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.322799 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.322987 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.323124 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.323326 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.323462 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.323639 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.323782 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.323972 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.324082 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.324266 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.324389 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.324576 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.324701 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.324886 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.325014 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.325213 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.325317 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.325524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.325632 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.325835 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.325947 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.326143 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.326258 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.326447 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.326575 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.326758 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.326890 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.327073 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.327226 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.327536 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.327677 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.327851 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.328048 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.328205 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.328351 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.328486 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.328642 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.328797 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.328977 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.329122 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.329298 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.329433 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.329631 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.329765 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.329961 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.330101 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.330276 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.330419 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.330585 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.330719 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.330888 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.331028 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.331217 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.331366 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.331526 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.331613 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.331840 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.331941 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.332147 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.332246 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.332456 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.332543 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.332764 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.332858 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.333076 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.333176 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.333381 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.333466 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.333688 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.333773 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.333992 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.334105 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.334300 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.334398 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.334613 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.334699 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.334918 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.335007 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.335251 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.335336 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.335558 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.335645 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.335869 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.335955 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.336178 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.336307 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.336634 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.336721 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.337013 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.337099 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.337329 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.337421 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.337642 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.337740 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.337953 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.338040 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.338268 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.338362 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.338590 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.338683 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.338962 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.339196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.339285 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.339526 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.339845 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.339931 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.340168 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.340253 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.340494 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.340580 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.340801 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.340900 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.341116 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.341208 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.341426 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.341512 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.341731 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.341834 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.342042 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.342129 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.342352 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.342438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.342663 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.342759 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.342970 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.343054 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.343301 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.343389 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.343611 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.343705 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.343914 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.344005 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.344226 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.344343 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.344533 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.344643 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.344838 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.344936 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.345141 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.345238 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.345446 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.345553 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.345753 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.345838 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.346058 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.346157 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.346362 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.346447 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.346664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.346753 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.346969 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.347063 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.347301 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.347389 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.347609 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.347708 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.347913 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.348049 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.348220 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.348306 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.348527 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.348612 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.348831 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.348925 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.349154 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.349239 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.349463 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.349548 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.349769 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.349856 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.350074 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.350159 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.350383 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.350469 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.350688 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.350782 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.350994 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.351081 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.351329 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.351428 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.351653 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.351745 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.352483 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.352643 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.352800 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.352947 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.353099 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.353276 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.353413 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.353623 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.353713 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.353948 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.354036 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.354261 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.354356 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.354579 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.354684 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.354889 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.354978 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.355216 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.355366 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.355528 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.355628 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.355832 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.355929 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.356150 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.356257 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.356459 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.356556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.356764 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.356864 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.357069 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.357165 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.357371 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.357477 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.357680 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.357784 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.357988 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.358085 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.358302 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.358409 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.358608 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.358706 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.358929 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.359028 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.359267 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.359380 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.359580 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.359676 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.359884 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.359979 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.360194 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.360298 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.360499 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.360596 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.360803 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.360900 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.361112 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.361209 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.361426 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.361522 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.361731 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.361834 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.362032 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.362120 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.362343 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.362429 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.362650 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.362744 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.362960 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.363046 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.363294 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.363395 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.363619 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.363704 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.363936 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.364030 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.364241 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.364332 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.364551 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.364706 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.364858 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.364944 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.365164 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.365250 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.365472 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.365566 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.365784 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.365888 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.366085 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.366182 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.366391 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.366486 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.366697 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.366784 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.367002 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.367089 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.367337 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.367437 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.367792 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.367934 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.368167 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.368255 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.368508 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.368596 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.368818 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.368912 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.369148 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.369298 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.369453 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.369541 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.369760 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.369846 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.370071 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.370168 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.370378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.370465 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.370689 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.370773 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.370995 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.371088 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.371368 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.371466 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.371684 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.371824 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.372002 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.372100 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.372312 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.372400 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.372631 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.372717 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.372941 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.373036 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.373256 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.373348 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.373565 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.373651 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.373868 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.373961 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.374189 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.374282 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.374502 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.374590 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.374816 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.374911 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.375140 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.375352 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.375487 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.375666 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.375822 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.375955 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.376131 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.376274 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.376442 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.376600 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.376755 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.376907 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.377067 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.377213 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.377379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.377519 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.377692 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.377840 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.378007 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.378152 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.378322 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.378475 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.378635 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.378895 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.378988 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.379234 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.379323 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.379544 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.379643 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.379864 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.379949 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.380175 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.380263 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.380483 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.380570 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.380808 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.380902 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.381122 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.381214 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.381432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.381521 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.381743 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.381831 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.382054 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.382143 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.382367 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.382457 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.382674 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.382759 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.382999 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.383640 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.383864 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.384023 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.384172 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.384271 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.384466 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.384569 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.384790 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.384931 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.385111 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.385197 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.385426 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.385525 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.385748 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.385834 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.386061 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.386165 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.386473 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.386570 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.386784 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.386893 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.387095 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.387203 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.387441 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.387536 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.387746 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.387845 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.388050 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.388136 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.388357 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.388442 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.388670 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.388766 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.388975 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.389068 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.389288 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.389404 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.389592 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.389691 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.389902 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.390002 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.390207 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.390318 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.390513 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.390610 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.390819 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.390918 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.391124 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.391242 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.391465 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.391557 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.391770 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.392031 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.392130 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.392272 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.392452 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.392585 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.392699 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.392911 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.393008 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.393234 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.393326 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.393569 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.393658 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.393881 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.393971 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.394196 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.394285 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.394502 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.394591 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.394807 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.394911 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.395137 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.395258 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.395468 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.395556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.395784 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.395873 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.396092 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.396192 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.396420 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.396523 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.396733 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.396835 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.397046 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.397135 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.397369 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.397459 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.397690 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.397785 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.398008 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.398097 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.398407 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.398502 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.398740 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.398843 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.399095 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.399205 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.399436 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.399533 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.399743 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.399844 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.400048 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.400145 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.400355 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.400444 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.400662 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.400751 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.400965 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.401053 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.401277 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.401449 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.401603 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.401749 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.401883 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.402035 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.402245 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.402386 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.402531 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.402664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.402803 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.402939 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.403069 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.403235 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.403406 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.403494 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.403711 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.403798 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.404029 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.404123 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.404347 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.404473 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.404671 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.404765 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.404979 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.405073 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.405302 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.405388 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.405616 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.405701 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.405921 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.406015 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.406233 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.406319 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.406543 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.406642 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.406855 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.406949 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.407191 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.407301 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.407512 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.407620 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.407824 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.407931 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.408139 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.408245 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.408459 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.408557 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.408777 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.408876 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.409110 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.409304 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.409436 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.409635 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.409741 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.409953 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.410072 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.410269 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.410363 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.410586 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.410674 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.410900 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.410994 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.411233 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.411340 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.411551 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.411644 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.411865 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.411953 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.412176 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.412313 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.412487 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.412595 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.412797 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.412904 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.413104 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.413203 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.413428 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.413526 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.413732 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.413829 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.414058 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.414167 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.414882 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.414984 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.415212 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.415311 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.415523 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.415647 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.415833 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.415922 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.416177 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.416273 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.416484 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.416588 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.416800 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.416907 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.417113 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.417202 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.417428 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.417526 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.417740 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.417829 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.418051 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.418140 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.418366 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.418524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.418683 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.418779 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.418996 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.419094 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.419332 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.419425 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.419650 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.419752 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.419961 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.420062 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.420278 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.420375 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.420598 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.420690 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.420922 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.421021 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.421231 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.421448 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.421551 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.421781 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.421872 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.422106 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.422356 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.422550 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.422690 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.422832 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.422977 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.423116 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.423333 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.423422 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.423661 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.423748 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.423975 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.424064 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.424292 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.424385 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.424606 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.424692 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.424916 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.425009 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.425222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.425310 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.425536 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.425624 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.425847 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.425943 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.426155 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.426242 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.426480 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.426577 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.426793 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.426933 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.427100 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.427205 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.427445 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.427545 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.427758 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.427846 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.428105 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.428290 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.428426 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.428645 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.428731 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.428962 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.429048 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.429289 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.429384 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.429616 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.429703 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.429936 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.430074 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.430293 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.430390 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.430618 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.430710 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.430928 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.431016 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.431258 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.431363 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.431575 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.431669 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.431884 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.431977 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.432189 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.432278 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.432494 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.432581 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.432807 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.432902 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.433115 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.433203 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.433419 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.433505 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.433730 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.433967 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.434066 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.434286 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.434380 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.434622 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.434709 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.434933 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.435020 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.435262 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.435352 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.435575 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.435663 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.435882 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.435978 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.436186 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.436273 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.436492 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.436578 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.436797 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.436885 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.437110 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.437204 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.437412 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.437539 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.437719 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.437806 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.438023 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.438110 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.438335 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.438421 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.438641 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.438728 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.438963 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.439057 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.439302 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.439404 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.439641 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.439842 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.439976 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.440195 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.440284 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.440517 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.440606 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.440840 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.440933 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.441163 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.441251 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.441478 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.441569 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.441788 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.441881 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.442117 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.442217 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.442430 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.442517 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.442743 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.442962 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.443053 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.443323 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.443414 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.443899 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.443992 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.444233 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.444321 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.444562 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.444650 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.444870 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.444957 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.445176 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.445269 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.445480 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.445566 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.446331 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.446496 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.446648 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.446791 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.446938 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.447026 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.447278 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.447375 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.447591 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.447694 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.447902 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.447991 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.448214 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.448310 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.448524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.448620 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.448834 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.449074 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.449168 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.449446 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.449570 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.449758 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.450067 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.450155 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.450376 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.450546 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.450686 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.451000 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.451087 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.451364 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.451537 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.451686 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.452005 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.452093 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.452323 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.452511 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.452644 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.452960 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.453214 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.453353 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.453574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.453807 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.453895 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.454236 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.454406 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.454565 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.454887 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.454983 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.455249 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.455567 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.455657 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.455983 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.456071 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.456417 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.456594 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.456739 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.457062 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.457149 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.457388 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.457483 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.457702 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.457808 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.458030 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.458285 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.458374 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.458633 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.458729 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.458967 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.459055 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.459309 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.459397 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.459644 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.459744 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.459984 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.460078 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.460304 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.460398 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.460620 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.460717 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.460927 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.461014 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.461289 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.461385 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.461612 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.461708 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.461926 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.462013 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.462242 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.462342 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.462551 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.462638 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.462857 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.462943 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.463224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.463319 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.463501 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.463590 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.463806 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.463892 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.464111 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.464199 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.464416 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.464512 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.464724 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.464811 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.465034 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.465133 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.465340 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.465428 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.465645 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.465732 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.465949 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.466056 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.466254 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.466344 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.466557 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.466643 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.466861 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.466960 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.467189 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.467277 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.467499 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.467640 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.467803 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.467892 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.468105 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.468192 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.468409 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.468497 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.468713 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.468801 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.469052 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.469138 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.469377 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.469472 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.469690 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.469779 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.470012 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.470119 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.470324 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.470423 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.470647 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.470734 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.470955 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.471041 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.471309 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.471413 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.471635 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.471722 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.471952 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.472038 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.472264 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.472361 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.472599 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.472687 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.472910 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.473004 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.473223 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.473323 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.473537 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.473625 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.473850 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.473936 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.474160 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.474248 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.474469 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.474556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.474797 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.474885 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.475104 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.475208 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.475441 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.475531 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.475769 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.475856 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.476085 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.476173 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.476393 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.476487 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.476702 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.476803 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.477528 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.477608 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.477860 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.477965 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.478172 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.478272 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.478482 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.478568 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.478790 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.478878 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.479102 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.479247 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.479435 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.479522 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.479744 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.479838 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.480050 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.480146 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.480359 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.480446 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.480666 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.480753 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.480974 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.481063 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.481287 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.481373 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.481594 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.481680 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.481900 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.481989 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.482205 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.482292 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.482513 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.482608 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.482819 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.482927 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.483172 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.483319 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.483512 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.483674 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.483833 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.483921 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.484166 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.484267 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.484482 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.484576 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.484791 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.484879 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.485038 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:24:08.485126 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.485414 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.485739 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.486059 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.486373 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.486709 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.487024 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.487375 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.487692 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.488007 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.488321 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.488635 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.488964 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.489293 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.489606 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.489936 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.490260 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.490586 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.490906 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.491246 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.491583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.491899 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.492213 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.492574 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.492890 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.493203 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.493522 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.493836 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.494155 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.494474 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.494791 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.495118 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.495470 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.495784 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.496110 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.496438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.496787 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.497103 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.497447 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.497777 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.498095 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.498409 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.498716 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:24:08.498963 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:24:08.640310 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO dbcounter [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Registered counter for database nova_api Sep 01 16:24:08.661000 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_db.sqlalchemy.engines [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:24:08.662162 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO dbcounter [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Registered counter for database nova_api Sep 01 16:24:08.667696 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writer thread running {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:24:08.683141 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_db.sqlalchemy.engines [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:24:08.689702 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writer thread running {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:24:08.725210 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.context [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82d7d12e-bed5-49fc-8bd1-b3172eaca82c(cell1) {{(pid=105877) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:24:08.729032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:24:08.729501 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:24:08.731049 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:24:08.731786 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:24:08.732231 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:24:08.734226 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:24:08.736207 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO dbcounter [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Registered counter for database nova_cell0 Sep 01 16:24:08.740295 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO dbcounter [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Registered counter for database nova_cell1 Sep 01 16:24:08.745193 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.context [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82d7d12e-bed5-49fc-8bd1-b3172eaca82c(cell1) {{(pid=105876) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:24:08.748458 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_db.sqlalchemy.engines [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:24:08.749160 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_concurrency.lockutils [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:24:08.749646 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_concurrency.lockutils [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:24:08.750643 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_db.sqlalchemy.engines [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:24:08.751247 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_concurrency.lockutils [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:24:08.751997 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_concurrency.lockutils [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:24:08.752448 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_concurrency.lockutils [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:24:08.754464 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_concurrency.lockutils [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:24:08.755703 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writer thread running {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:24:08.756497 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO dbcounter [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Registered counter for database nova_cell0 Sep 01 16:24:08.761658 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writer thread running {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:24:08.762577 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO dbcounter [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Registered counter for database nova_cell1 Sep 01 16:24:08.769645 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_db.sqlalchemy.engines [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:24:08.771335 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_db.sqlalchemy.engines [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:24:08.776773 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writer thread running {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:24:08.781981 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writer thread running {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:24:08.902745 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO dbcounter [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Registered counter for database nova_cell0 Sep 01 16:24:08.911478 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_db.sqlalchemy.engines [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:24:08.916002 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writer thread running {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:24:08.923345 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO dbcounter [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Registered counter for database nova_cell0 Sep 01 16:24:08.932789 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG oslo_db.sqlalchemy.engines [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:24:08.937041 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writer thread running {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:24:09.318331 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: WARNING keystonemiddleware.auth_token [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:24:09.326259 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: WARNING keystonemiddleware.auth_token [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:24:09.349426 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: WARNING keystonemiddleware.auth_token [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:24:09.357012 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: WARNING keystonemiddleware.auth_token [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:24:09.669339 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: WARNING keystonemiddleware.auth_token [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:24:09.675338 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: WARNING keystonemiddleware.auth_token [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:24:09.681128 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dc43a6f9c0 pid: 105877 (default app) Sep 01 16:24:09.683190 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:09.684394 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Sep 01 16:24:09.684811 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Thu Sep 1 16:24:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:09.700138 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: WARNING keystonemiddleware.auth_token [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:24:09.706225 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: WARNING keystonemiddleware.auth_token [None req-179db8d9-5f63-4dbf-a57e-763341489836 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:24:09.712076 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dc43a6f9c0 pid: 105876 (default app) Sep 01 16:25:31.688941 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:31.690147 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Sep 01 16:25:31.690674 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:25:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:31.703241 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writing DB stats nova_api:SELECT=3 {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:31.704355 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writing DB stats nova_cell1:SELECT=3 {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:31.705196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writing DB stats nova_cell0:SELECT=3 {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:31.706306 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:32.583743 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-bd3b5971-693b-4a47-bb03-84ed877582ed admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:32.615356 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-bd3b5971-693b-4a47-bb03-84ed877582ed admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917773 Sep 01 16:25:32.615997 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 1 16:25:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:35.008624 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:35.009574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-b7f1805b-6b46-48e2-8ddb-c65818c478a4 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Sep 01 16:25:35.015227 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:25:35 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:35.457305 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-f649936c-d215-466e-b5c8-8c8bab082ae9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "ram": 256}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:35.564776 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-f649936c-d215-466e-b5c8-8c8bab082ae9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.548396 Sep 01 16:25:35.565826 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:25:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:25:35.580970 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_api:SELECT=3 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.582186 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_cell0:SELECT=3 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.582953 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_cell1:SELECT=3 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.584111 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.793314 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-58ac72e0-dcbc-4de1-b521-fb2ecdf1d608 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:35.904044 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-58ac72e0-dcbc-4de1-b521-fb2ecdf1d608 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.329239 Sep 01 16:25:35.904633 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 16:25:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:38.286369 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-f649936c-d215-466e-b5c8-8c8bab082ae9 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:38.287423 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-f649936c-d215-466e-b5c8-8c8bab082ae9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 01 16:25:38.287981 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:25:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:39.080844 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-22fe05eb-9d2e-42ee-b3ca-3d3ef3e5a8e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "rxtx_factor": 1.0}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:39.206395 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-22fe05eb-9d2e-42ee-b3ca-3d3ef3e5a8e3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.912211 Sep 01 16:25:39.211865 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:25:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:25:39.220154 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-fd402b40-60e4-402c-8d2b-ad9dae4a94c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:39.334728 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-fd402b40-60e4-402c-8d2b-ad9dae4a94c4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119020 Sep 01 16:25:39.336109 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 16:25:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:25:41.729956 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-22fe05eb-9d2e-42ee-b3ca-3d3ef3e5a8e3 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:41.731179 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-22fe05eb-9d2e-42ee-b3ca-3d3ef3e5a8e3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Sep 01 16:25:41.731580 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:25:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:42.128677 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-b7259076-b513-41ff-b7a2-c59fc7bc4f52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "ram": 1024, "id": "d2"}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:42.203394 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-b7259076-b513-41ff-b7a2-c59fc7bc4f52 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465463 Sep 01 16:25:42.203881 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:25:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:25:42.216560 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-1b5a065c-feac-4009-a0b0-6bf87e4ab038 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:42.287052 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-1b5a065c-feac-4009-a0b0-6bf87e4ab038 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074503 Sep 01 16:25:42.287689 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 16:25:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:44.676847 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-b7259076-b513-41ff-b7a2-c59fc7bc4f52 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:44.678035 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-b7259076-b513-41ff-b7a2-c59fc7bc4f52 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Sep 01 16:25:44.678522 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:45.106765 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-c38580dc-266a-4563-85a6-0ced1d54c9f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:45.289176 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-c38580dc-266a-4563-85a6-0ced1d54c9f4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.603278 Sep 01 16:25:45.289731 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:25:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:25:45.303476 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ee123c42-afa1-4c53-b9dc-8efc7b044c0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:45.499061 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ee123c42-afa1-4c53-b9dc-8efc7b044c0a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.199517 Sep 01 16:25:45.499761 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 16:25:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:47.900223 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-c38580dc-266a-4563-85a6-0ced1d54c9f4 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:47.901212 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-c38580dc-266a-4563-85a6-0ced1d54c9f4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 01 16:25:47.901963 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:25:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:48.340337 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-15a41724-9b0f-44f0-9e9b-785d19d1386d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "ram": 4096}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:48.444255 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-15a41724-9b0f-44f0-9e9b-785d19d1386d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.530583 Sep 01 16:25:48.444255 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:25:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:25:48.452770 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-84ca6ea7-1184-4d43-a5f9-4a54febf3cda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:48.549516 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-84ca6ea7-1184-4d43-a5f9-4a54febf3cda admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098870 Sep 01 16:25:48.549516 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 16:25:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:51.687942 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-15a41724-9b0f-44f0-9e9b-785d19d1386d admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:51.689360 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-15a41724-9b0f-44f0-9e9b-785d19d1386d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Sep 01 16:25:51.689984 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:25:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:52.153738 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-035eda77-760d-4fcc-88e1-d5373a227102 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:52.178397 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-035eda77-760d-4fcc-88e1-d5373a227102 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.481933 Sep 01 16:25:52.178950 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 1 16:25:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:25:54.586637 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-15a41724-9b0f-44f0-9e9b-785d19d1386d admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:54.587667 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-15a41724-9b0f-44f0-9e9b-785d19d1386d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 01 16:25:54.588606 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:55.005798 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-4f2b1d54-2aa4-433b-98f6-89d0af205ef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "id": "1", "disk": 1, "vcpus": 1, "name": "m1.tiny"}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:55.077133 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-4f2b1d54-2aa4-433b-98f6-89d0af205ef1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.481874 Sep 01 16:25:55.077843 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:25:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:25:55.089843 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-64bd9f9e-ca77-42f9-89ad-28f7d401cfb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:55.189428 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-64bd9f9e-ca77-42f9-89ad-28f7d401cfb2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103233 Sep 01 16:25:55.190060 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 16:25:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:57.601804 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-4f2b1d54-2aa4-433b-98f6-89d0af205ef1 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:57.602843 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-4f2b1d54-2aa4-433b-98f6-89d0af205ef1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 01 16:25:57.603613 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:25:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:58.034357 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ceda8959-aab8-42ed-842e-7ef8bc2922c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "ram": 2048}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:58.093277 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ceda8959-aab8-42ed-842e-7ef8bc2922c7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.482543 Sep 01 16:25:58.093834 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:25:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:25:58.106384 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-5716ee48-fed1-48ec-a30c-a8aaf126bcff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:25:58.200639 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-5716ee48-fed1-48ec-a30c-a8aaf126bcff admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098322 Sep 01 16:25:58.201227 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 16:25:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:00.584983 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ceda8959-aab8-42ed-842e-7ef8bc2922c7 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:00.586745 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ceda8959-aab8-42ed-842e-7ef8bc2922c7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Sep 01 16:26:00.588662 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:26:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:01.083425 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-206d3b60-b723-480d-bc1d-65a526bb0980 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3"}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:01.706999 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-206d3b60-b723-480d-bc1d-65a526bb0980 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.112330 Sep 01 16:26:01.708642 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:26:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:26:01.722101 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-a83ed871-c9ba-4e3d-b720-1038284d9ae8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:01.833671 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-a83ed871-c9ba-4e3d-b720-1038284d9ae8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116666 Sep 01 16:26:01.834246 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 16:26:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:04.233900 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-206d3b60-b723-480d-bc1d-65a526bb0980 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:04.234918 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-206d3b60-b723-480d-bc1d-65a526bb0980 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 01 16:26:04.235754 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:04.687480 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-e3937295-a346-49d8-bf59-7a32cd0f48f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "ram": 8192}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:04.698519 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:04.777957 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-e3937295-a346-49d8-bf59-7a32cd0f48f2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.536307 Sep 01 16:26:04.779996 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:26:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:26:04.793379 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-86605f98-6395-4b00-a14d-8089d3281699 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:04.869277 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-86605f98-6395-4b00-a14d-8089d3281699 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079923 Sep 01 16:26:04.870037 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 16:26:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:07.287652 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-e3937295-a346-49d8-bf59-7a32cd0f48f2 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:07.289575 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-e3937295-a346-49d8-bf59-7a32cd0f48f2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002252 Sep 01 16:26:07.292433 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:07.734751 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-2bccdcf0-e804-4ad5-8a5f-f4819213cbe8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "id": "5"}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:07.812744 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-2bccdcf0-e804-4ad5-8a5f-f4819213cbe8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.513506 Sep 01 16:26:07.813656 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 16:26:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:26:07.827982 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-c8361bc1-6570-4b45-b0a3-612a3b83dbc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:07.941004 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-c8361bc1-6570-4b45-b0a3-612a3b83dbc4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117911 Sep 01 16:26:07.943194 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 16:26:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:26:26.242110 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-2bccdcf0-e804-4ad5-8a5f-f4819213cbe8 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:26.243040 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-2bccdcf0-e804-4ad5-8a5f-f4819213cbe8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 01 16:26:26.243480 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:26:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:26:26.637086 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-934bb130-84b7-4537-8470-e72529187da3 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:26.655935 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-934bb130-84b7-4537-8470-e72529187da3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406174 Sep 01 16:26:26.656463 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 1 16:26:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:26:27.727606 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-2bccdcf0-e804-4ad5-8a5f-f4819213cbe8 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:27.728597 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-2bccdcf0-e804-4ad5-8a5f-f4819213cbe8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 01 16:26:27.728983 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:28.255908 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-97775aae-810b-4583-b9c4-7d60f7c28a88 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:28.261529 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.wsgi [None req-97775aae-810b-4583-b9c4-7d60f7c28a88 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-97775aae-810b-4583-b9c4-7d60f7c28a88 admin admin] Request method failure captured: Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Accept: application/json Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Accept-Encoding: gzip, deflate Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Connection: keep-alive Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Content-Length: 0 Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Host: 10.222.0.16 Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Openstack-Api-Version: compute 2.90 Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Openstack-System-Scope: None Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: User-Agent: python-novaclient Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Auth-Token: gAAAAABjEN0zcESyvTZM7Sh-vE28E3m0LfmRivHb7xAAd7JD7eSW8F8W1rhqUp1ldNDSxK3t0RZuxJKyeQlA7tb6cheEhdKmkeYNkOX-jEO5oedO9Fad9zcxdftqD8qesmf1hredRiSTDdwcMDQeAP0VPRRjq_R-tuHPpTbrWUuZPL7vJDR8ros Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Domain-Id: None Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Domain-Name: None Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Identity-Status: Confirmed Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Is-Admin-Project: True Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Domain-Id: default Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Domain-Name: Default Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Name: admin Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Role: reader,member,admin Sep 01 16:26:28.264800 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Roles: reader,member,admin Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18a3d39073f24e449904bb491fbe8869", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Tenant: admin Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Tenant-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Tenant-Name: admin Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User: admin Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Domain-Id: default Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Domain-Name: Default Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Id: f9fb5099a6c24abebce19b1a9dfe02b2 Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Name: admin Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: method: > Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: exception: Flavor 42 could not be found. Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: action_args: {'id': '42'} Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:26:28.266432 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:28.267438 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.268556 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-97775aae-810b-4583-b9c4-7d60f7c28a88 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:26:28.269599 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-97775aae-810b-4583-b9c4-7d60f7c28a88 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398429 Sep 01 16:26:28.269599 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 1 16:26:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:28.276615 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-f8d1557b-4545-4b48-823d-3e2323b7d406 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:28.280890 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:28.301535 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-f8d1557b-4545-4b48-823d-3e2323b7d406 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028402 Sep 01 16:26:28.302118 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 16:26:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:26:28.311906 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-fbb4445e-2ab9-4385-9368-a3e308416528 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:28.336355 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-fbb4445e-2ab9-4385-9368-a3e308416528 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027974 Sep 01 16:26:28.336889 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 16:26:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:26:28.346553 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-d6e6e553-2c04-452d-8fb8-c846b972685b admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:28.352950 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.wsgi [None req-d6e6e553-2c04-452d-8fb8-c846b972685b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-d6e6e553-2c04-452d-8fb8-c846b972685b admin admin] Request method failure captured: Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Accept: application/json Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Accept-Encoding: gzip, deflate Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Connection: keep-alive Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Content-Length: 0 Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Host: 10.222.0.16 Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Openstack-Api-Version: compute 2.90 Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Openstack-System-Scope: None Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: User-Agent: python-novaclient Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Auth-Token: gAAAAABjEN0zcESyvTZM7Sh-vE28E3m0LfmRivHb7xAAd7JD7eSW8F8W1rhqUp1ldNDSxK3t0RZuxJKyeQlA7tb6cheEhdKmkeYNkOX-jEO5oedO9Fad9zcxdftqD8qesmf1hredRiSTDdwcMDQeAP0VPRRjq_R-tuHPpTbrWUuZPL7vJDR8ros Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Domain-Id: None Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Domain-Name: None Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Identity-Status: Confirmed Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Is-Admin-Project: True Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Domain-Id: default Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Domain-Name: Default Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Name: admin Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Role: reader,member,admin Sep 01 16:26:28.356224 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Roles: reader,member,admin Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18a3d39073f24e449904bb491fbe8869", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Tenant: admin Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Tenant-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Tenant-Name: admin Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User: admin Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Domain-Id: default Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Domain-Name: Default Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Id: f9fb5099a6c24abebce19b1a9dfe02b2 Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Name: admin Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: method: > Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: exception: Flavor 42 could not be found. Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: action_args: {'id': '42'} Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:26:28.358498 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:28.359408 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:28.360664 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-d6e6e553-2c04-452d-8fb8-c846b972685b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:26:28.361841 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-d6e6e553-2c04-452d-8fb8-c846b972685b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014980 Sep 01 16:26:28.361841 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 1 16:26:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 16:26:29.347534 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-fbb4445e-2ab9-4385-9368-a3e308416528 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:29.349061 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-fbb4445e-2ab9-4385-9368-a3e308416528 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Sep 01 16:26:29.349691 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:26:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:29.877405 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-c6bc9b4a-88a7-42cd-bfb6-76fc33901bfb admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:29.883456 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.wsgi [None req-c6bc9b4a-88a7-42cd-bfb6-76fc33901bfb admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-c6bc9b4a-88a7-42cd-bfb6-76fc33901bfb admin admin] Request method failure captured: Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Accept: application/json Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Accept-Encoding: gzip, deflate Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Connection: keep-alive Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Content-Length: 0 Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Host: 10.222.0.16 Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Openstack-Api-Version: compute 2.90 Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Openstack-System-Scope: None Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: User-Agent: python-novaclient Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Auth-Token: gAAAAABjEN01aufj_lPAGQm7Axc0EfCuSW5u0GK71CfBRo71hBAtQ_xiFZGfyIU3SPOe1QdAdtHkSVKoydUcxcgvYGs7B9KNB-yol0oidSOFq6CFeg2UntUylgqn0IP3c6MNYsWhfVvHw_OpaaTwbnmyS6Kq27tcaBzRxCAZSdp0SD56JYeBRHI Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Domain-Id: None Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Domain-Name: None Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Identity-Status: Confirmed Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Is-Admin-Project: True Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Domain-Id: default Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Domain-Name: Default Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Name: admin Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Role: reader,member,admin Sep 01 16:26:29.884959 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Roles: reader,member,admin Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18a3d39073f24e449904bb491fbe8869", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Tenant: admin Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Tenant-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Tenant-Name: admin Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User: admin Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Domain-Id: default Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Domain-Name: Default Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Id: f9fb5099a6c24abebce19b1a9dfe02b2 Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Name: admin Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: method: > Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: exception: Flavor 84 could not be found. Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: action_args: {'id': '84'} Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:26:29.886471 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:29.887378 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.888524 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-c6bc9b4a-88a7-42cd-bfb6-76fc33901bfb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:26:29.889673 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-c6bc9b4a-88a7-42cd-bfb6-76fc33901bfb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396392 Sep 01 16:26:29.889673 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 1 16:26:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:29.896172 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-a4b0eeb8-4c57-4c8e-b1fe-afdca31f95ce admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:29.910731 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-a4b0eeb8-4c57-4c8e-b1fe-afdca31f95ce admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018270 Sep 01 16:26:29.911273 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 16:26:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:26:29.920500 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-f9e7afa8-9546-40fe-a9b1-2659ee63b533 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:29.935609 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-f9e7afa8-9546-40fe-a9b1-2659ee63b533 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018608 Sep 01 16:26:29.936123 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 16:26:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:26:29.946057 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-6d4c1b5e-53d1-4101-b86d-7f5ce87a4e06 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:29.951233 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.wsgi [None req-6d4c1b5e-53d1-4101-b86d-7f5ce87a4e06 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-6d4c1b5e-53d1-4101-b86d-7f5ce87a4e06 admin admin] Request method failure captured: Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Accept: application/json Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Accept-Encoding: gzip, deflate Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Connection: keep-alive Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Content-Length: 0 Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Host: 10.222.0.16 Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Openstack-Api-Version: compute 2.90 Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Openstack-System-Scope: None Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: User-Agent: python-novaclient Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Auth-Token: gAAAAABjEN01aufj_lPAGQm7Axc0EfCuSW5u0GK71CfBRo71hBAtQ_xiFZGfyIU3SPOe1QdAdtHkSVKoydUcxcgvYGs7B9KNB-yol0oidSOFq6CFeg2UntUylgqn0IP3c6MNYsWhfVvHw_OpaaTwbnmyS6Kq27tcaBzRxCAZSdp0SD56JYeBRHI Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Domain-Id: None Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Domain-Name: None Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Identity-Status: Confirmed Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Is-Admin-Project: True Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Domain-Id: default Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Domain-Name: Default Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Name: admin Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Role: reader,member,admin Sep 01 16:26:29.952723 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Roles: reader,member,admin Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18a3d39073f24e449904bb491fbe8869", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Tenant: admin Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Tenant-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Tenant-Name: admin Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User: admin Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Domain-Id: default Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Domain-Name: Default Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Id: f9fb5099a6c24abebce19b1a9dfe02b2 Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Name: admin Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: method: > Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: exception: Flavor 84 could not be found. Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: action_args: {'id': '84'} Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:26:29.954196 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:29.955139 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:29.956445 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-6d4c1b5e-53d1-4101-b86d-7f5ce87a4e06 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:26:29.957657 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-6d4c1b5e-53d1-4101-b86d-7f5ce87a4e06 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012320 Sep 01 16:26:29.957657 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 1 16:26:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:30.964814 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-f9e7afa8-9546-40fe-a9b1-2659ee63b533 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:30.965812 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-f9e7afa8-9546-40fe-a9b1-2659ee63b533 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 01 16:26:30.966197 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:26:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:31.492009 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-5be8ce1f-4669-4365-bccb-d99f9b50fd60 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:31.497698 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.wsgi [None req-5be8ce1f-4669-4365-bccb-d99f9b50fd60 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-5be8ce1f-4669-4365-bccb-d99f9b50fd60 admin admin] Request method failure captured: Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Accept: application/json Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Accept-Encoding: gzip, deflate Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Connection: keep-alive Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Content-Length: 0 Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Host: 10.222.0.16 Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Openstack-Api-Version: compute 2.90 Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Openstack-System-Scope: None Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: User-Agent: python-novaclient Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Auth-Token: gAAAAABjEN02euSn44ZVqxF4aRaWH_r_GhtSBKvDxpKDd-V946Nnd8q6N8jG7oTKDHWCZJNlpbwT-sxbgIZCPsIPECd5UhD6JKHJ815VkZW-SkKq9iHpmNsUiQvAOGZqrwZaYvU7lG-1nHk-l6ZIKsHMoV603ZzI-lzQI4nJHGHgxA1fuXR1J5U Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Domain-Id: None Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Domain-Name: None Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Identity-Status: Confirmed Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Is-Admin-Project: True Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Domain-Id: default Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Domain-Name: Default Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Project-Name: admin Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Role: reader,member,admin Sep 01 16:26:31.499237 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Roles: reader,member,admin Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18a3d39073f24e449904bb491fbe8869", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Tenant: admin Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Tenant-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-Tenant-Name: admin Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User: admin Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Domain-Id: default Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Domain-Name: Default Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Id: f9fb5099a6c24abebce19b1a9dfe02b2 Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: X-User-Name: admin Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: method: > Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: exception: Flavor 451 could not be found. Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: action_args: {'id': '451'} Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:26:31.500583 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:31.501379 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.502434 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-5be8ce1f-4669-4365-bccb-d99f9b50fd60 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:26:31.503520 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-5be8ce1f-4669-4365-bccb-d99f9b50fd60 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392932 Sep 01 16:26:31.504415 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 16:26:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:31.510840 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-bbe64abc-91fb-40a9-b7c2-12e331b50b4d admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:31.525696 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-bbe64abc-91fb-40a9-b7c2-12e331b50b4d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018450 Sep 01 16:26:31.526229 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 16:26:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:26:31.536336 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:31.551042 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018841 Sep 01 16:26:31.552195 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 16:26:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:26:31.561516 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-89b7345e-1589-4f3d-8ef9-3b3ebd95e01f admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:31.566815 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.wsgi [None req-89b7345e-1589-4f3d-8ef9-3b3ebd95e01f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-89b7345e-1589-4f3d-8ef9-3b3ebd95e01f admin admin] Request method failure captured: Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Accept: application/json Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Accept-Encoding: gzip, deflate Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Connection: keep-alive Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Content-Length: 0 Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Host: 10.222.0.16 Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Openstack-Api-Version: compute 2.90 Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Openstack-System-Scope: None Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: User-Agent: python-novaclient Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Auth-Token: gAAAAABjEN02euSn44ZVqxF4aRaWH_r_GhtSBKvDxpKDd-V946Nnd8q6N8jG7oTKDHWCZJNlpbwT-sxbgIZCPsIPECd5UhD6JKHJ815VkZW-SkKq9iHpmNsUiQvAOGZqrwZaYvU7lG-1nHk-l6ZIKsHMoV603ZzI-lzQI4nJHGHgxA1fuXR1J5U Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Domain-Id: None Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Domain-Name: None Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Identity-Status: Confirmed Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Is-Admin-Project: True Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Domain-Id: default Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Domain-Name: Default Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Project-Name: admin Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Role: reader,member,admin Sep 01 16:26:31.568574 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Roles: reader,member,admin Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18a3d39073f24e449904bb491fbe8869", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18a3d39073f24e449904bb491fbe8869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Tenant: admin Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Tenant-Id: 18a3d39073f24e449904bb491fbe8869 Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-Tenant-Name: admin Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User: admin Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Domain-Id: default Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Domain-Name: Default Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Id: f9fb5099a6c24abebce19b1a9dfe02b2 Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: X-User-Name: admin Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: method: > Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: exception: Flavor 451 could not be found. Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: action_args: {'id': '451'} Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:26:31.570222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:31.570988 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: ERROR nova.api.openstack.wsgi Sep 01 16:26:31.572032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-89b7345e-1589-4f3d-8ef9-3b3ebd95e01f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:26:31.573099 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-89b7345e-1589-4f3d-8ef9-3b3ebd95e01f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012235 Sep 01 16:26:31.573099 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 16:26:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:32.531663 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:32.532679 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Sep 01 16:26:32.533080 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:33.062858 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-8a006f7a-9459-4182-9a97-356a7536d162 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:33.138265 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-8a006f7a-9459-4182-9a97-356a7536d162 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.467759 Sep 01 16:26:33.138843 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 1 16:26:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:26:34.106066 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:34.107074 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 01 16:26:34.107494 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:34.643449 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-e626e82e-3266-4375-9227-53547cbfdd2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:34.712032 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-e626e82e-3266-4375-9227-53547cbfdd2a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.456385 Sep 01 16:26:34.714793 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 1 16:26:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:26:35.686287 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:35.687325 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 01 16:26:35.687721 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:26:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:36.204325 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-1ad1aaca-adc9-407b-ab43-0a7cb039a1af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:36.294750 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-1ad1aaca-adc9-407b-ab43-0a7cb039a1af admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.470126 Sep 01 16:26:36.295340 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 1 16:26:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:26:37.283083 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:37.284132 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 01 16:26:37.284519 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:37.811230 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-8a136dcf-5041-4d77-a7ee-7fc89110b0de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:26:37.980322 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-8a136dcf-5041-4d77-a7ee-7fc89110b0de admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.556098 Sep 01 16:26:37.980872 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 1 16:26:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:26:39.063907 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:39.064923 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 01 16:26:39.065315 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:26:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:26:39.592596 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-80f18abc-149f-4102-824a-395922a063b1 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:26:39.620929 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-80f18abc-149f-4102-824a-395922a063b1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.418656 Sep 01 16:26:39.621665 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Thu Sep 1 16:26:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:27:33.318663 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:33.319770 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-ff92bf08-c79b-4518-90bc-af4bdf7c9d8e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Sep 01 16:27:33.320167 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 16:27:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:27:33.331384 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:33.709114 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-187e4746-bb08-4f9b-91b8-2512bb4ec6dc admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:33.729895 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-187e4746-bb08-4f9b-91b8-2512bb4ec6dc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402981 Sep 01 16:27:33.730415 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 1 16:27:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:27:33.752093 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG dbcounter [-] [105876] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:33.755728 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-6d8f5aed-c242-4713-9e9c-7064b68e22f9 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:33.763121 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-6d8f5aed-c242-4713-9e9c-7064b68e22f9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012477 Sep 01 16:27:33.764050 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Thu Sep 1 16:27:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:27:33.775602 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-467938c3-6ab5-414d-9d12-f42ae6d74c97 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:33.784041 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-467938c3-6ab5-414d-9d12-f42ae6d74c97 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012012 Sep 01 16:27:33.784546 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Thu Sep 1 16:27:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:33.796464 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:33.804152 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012006 Sep 01 16:27:33.804655 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Thu Sep 1 16:27:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:27:33.816319 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-090d1c41-6232-4732-8ed3-a2eaedb67267 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:27:33.823946 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-090d1c41-6232-4732-8ed3-a2eaedb67267 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011340 Sep 01 16:27:33.824449 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Thu Sep 1 16:27:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:30:47.906112 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:47.907125 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 01 16:30:47.907757 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:48.049996 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_api:SELECT=6 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:48.214379 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-190a4762-fbec-4084-8704-efc15f45388f admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:48.217953 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-190a4762-fbec-4084-8704-efc15f45388f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:30:48.218438 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-190a4762-fbec-4084-8704-efc15f45388f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:30:48.219096 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-190a4762-fbec-4084-8704-efc15f45388f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:30:48.219928 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-190a4762-fbec-4084-8704-efc15f45388f admin admin] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:30:48.220383 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-190a4762-fbec-4084-8704-efc15f45388f admin admin] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:30:48.220808 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-190a4762-fbec-4084-8704-efc15f45388f admin admin] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:30:48.258318 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-190a4762-fbec-4084-8704-efc15f45388f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.209826 Sep 01 16:30:48.258941 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 16:30:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:30:49.095645 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:49.096658 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 01 16:30:49.097052 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:49.292483 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-7ce849be-8547-414a-ba3d-078c3062e64c admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:49.296823 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-7ce849be-8547-414a-ba3d-078c3062e64c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:30:49.297303 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-7ce849be-8547-414a-ba3d-078c3062e64c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:30:49.297734 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-7ce849be-8547-414a-ba3d-078c3062e64c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:30:49.298447 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-7ce849be-8547-414a-ba3d-078c3062e64c admin admin] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:30:49.298895 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-7ce849be-8547-414a-ba3d-078c3062e64c admin admin] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:30:49.299351 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-7ce849be-8547-414a-ba3d-078c3062e64c admin admin] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:30:49.320391 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-7ce849be-8547-414a-ba3d-078c3062e64c admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082033 Sep 01 16:30:49.321510 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 16:30:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:31:00.598059 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:00.599129 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Sep 01 16:31:00.599576 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:00.747034 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_cell0:SELECT=4 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:00.747798 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_cell1:SELECT=4 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:00.748415 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG dbcounter [-] [105877] Writing DB stats nova_api:SELECT=8 {{(pid=105877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:00.802889 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-3f73ede4-ab4f-44d4-a775-2dd9e83bcda3 admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:00.806283 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-3f73ede4-ab4f-44d4-a775-2dd9e83bcda3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:00.806767 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-3f73ede4-ab4f-44d4-a775-2dd9e83bcda3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:00.807222 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-3f73ede4-ab4f-44d4-a775-2dd9e83bcda3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:00.808000 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-3f73ede4-ab4f-44d4-a775-2dd9e83bcda3 admin admin] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:00.808454 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-3f73ede4-ab4f-44d4-a775-2dd9e83bcda3 admin admin] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:00.808872 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-3f73ede4-ab4f-44d4-a775-2dd9e83bcda3 admin admin] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:00.837526 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-3f73ede4-ab4f-44d4-a775-2dd9e83bcda3 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095449 Sep 01 16:31:00.838147 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 16:31:00 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:01.692623 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: DEBUG nova.api.openstack.wsgi [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] Calling method '>' {{(pid=105876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:01.693635 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: INFO nova.api.openstack.requestlog [None req-22708ec0-12cd-438d-bfda-1a050a865370 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 01 16:31:01.694030 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: [pid: 105876|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 16:31:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:31:01.889043 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG nova.api.openstack.wsgi [None req-5012b0d4-b2d2-461a-93d8-d9c07c84e17f admin admin] Calling method '>' {{(pid=105877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:01.892551 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-5012b0d4-b2d2-461a-93d8-d9c07c84e17f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:01.893033 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-5012b0d4-b2d2-461a-93d8-d9c07c84e17f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:01.893463 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-5012b0d4-b2d2-461a-93d8-d9c07c84e17f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:01.894175 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-5012b0d4-b2d2-461a-93d8-d9c07c84e17f admin admin] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:01.894625 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-5012b0d4-b2d2-461a-93d8-d9c07c84e17f admin admin] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:01.895044 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: DEBUG oslo_concurrency.lockutils [None req-5012b0d4-b2d2-461a-93d8-d9c07c84e17f admin admin] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:01.918194 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: INFO nova.api.openstack.requestlog [None req-5012b0d4-b2d2-461a-93d8-d9c07c84e17f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083014 Sep 01 16:31:01.918753 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: [pid: 105877|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 16:31:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:03.806154 dv-cinder-836027-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 16:32:03.807314 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: Thu Sep 1 16:32:03 2022 - graceful shutdown triggered... Sep 01 16:32:03.808190 dv-cinder-836027-9-iscsi devstack@n-api.service[105876]: Gracefully killing worker 1 (pid: 105876)... Sep 01 16:32:03.808641 dv-cinder-836027-9-iscsi devstack@n-api.service[105877]: Gracefully killing worker 2 (pid: 105877)... Sep 01 16:32:04.807923 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: worker 1 buried after 1 seconds Sep 01 16:32:04.807923 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: worker 2 buried after 1 seconds Sep 01 16:32:04.807923 dv-cinder-836027-9-iscsi devstack@n-api.service[105875]: goodbye to uWSGI. Sep 01 16:32:04.809516 dv-cinder-836027-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 16:32:04.810069 dv-cinder-836027-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 16:32:04.813132 dv-cinder-836027-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 16:32:04.825710 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:32:04 2022] *** Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: nodename: dv-cinder-836027-9-iscsi Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: machine: x86_64 Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: clock source: unix Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: pcre jit disabled Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: detected number of CPU cores: 4 Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: current working directory: / Sep 01 16:32:04.828724 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:32:04.829425 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: your processes number limit is 47680 Sep 01 16:32:04.829425 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: your memory page size is 4096 bytes Sep 01 16:32:04.829425 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: detected max file descriptor number: 2048 Sep 01 16:32:04.829425 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: lock engine: pthread robust mutexes Sep 01 16:32:04.829425 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: thunder lock: enabled Sep 01 16:32:04.829425 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 16:32:04.829425 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:32:04.869447 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: Python main interpreter initialized at 0x5584399799c0 Sep 01 16:32:04.869447 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: python threads support enabled Sep 01 16:32:04.869447 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: your server socket listen backlog is limited to 100 connections Sep 01 16:32:04.869447 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:32:04.869935 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:32:04.870027 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: *** Operational MODE: preforking *** Sep 01 16:32:04.870290 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:32:04.870290 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: spawned uWSGI master process (pid: 127518) Sep 01 16:32:04.870497 dv-cinder-836027-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 16:32:04.871069 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: spawned uWSGI worker 1 (pid: 127531, cores: 1) Sep 01 16:32:04.871619 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: spawned uWSGI worker 2 (pid: 127532, cores: 1) Sep 01 16:32:04.871899 dv-cinder-836027-9-iscsi devstack@n-api.service[127518]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:32:05.609139 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:32:05.613206 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:32:06.784900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:32:06.784900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: from cryptography.utils import int_from_bytes Sep 01 16:32:06.785562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:32:06.785562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: from cryptography.utils import int_from_bytes Sep 01 16:32:06.793973 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:32:06.793973 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: from cryptography.utils import int_from_bytes Sep 01 16:32:06.794438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:32:06.794438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: from cryptography.utils import int_from_bytes Sep 01 16:32:09.260693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:32:09.260693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:32:09.260693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:32:09.260693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:32:09.260693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:32:09.260693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.260693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.260693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.261816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.261816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.261816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.261816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.261816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.261816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.262219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.262219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.262699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-9-iscsi {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.263006 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.263350 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.263669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.263996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.264305 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.264631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.264941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.265445 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.266191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.266784 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.267279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.267780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.268285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.268757 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.269243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.269710 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.270201 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.270675 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.271280 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-9-iscsi {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.272620 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.272940 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.273428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.274076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.274566 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.274888 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.275255 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.275599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.275913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.276263 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.276589 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.276919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.277245 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.277552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.277862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.278179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.278499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.278811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.279118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.279399 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.279710 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.280035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.280364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.280689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.280941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.281196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.281522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.281848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.282155 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.282464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.282770 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.283075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.283428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.283736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.284047 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.284354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.284675 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.284991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.285312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.285619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.285939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.286350 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.286600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.286913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.287325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.287650 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.287820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:32:09.288311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.288458 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:32:09.288615 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.288615 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.288919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:32:09.289072 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.289227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:32:09.289379 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.289552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:32:09.289698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.289841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.289983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.290133 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.290293 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.290468 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.290611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.290761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.290922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.291078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.291260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.291260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.291575 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.291575 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.291874 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.291874 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.292177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.292333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.292476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.292476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.292753 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.292909 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.293061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.293260 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-9-iscsi {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.293422 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.293422 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.293699 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.293858 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.294010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.294175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.294326 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.295216 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.295389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.295549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.295693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.295844 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.295988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.296144 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.296307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.296469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.296469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.296855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.297029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.297184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.297342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.297494 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.297644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.297798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.297966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.298118 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.298276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.298429 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.298580 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.298733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.298884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.299027 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.299196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.299356 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.299499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.299651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.299801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.299965 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.300116 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.300268 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-9-iscsi {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.300420 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.300563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.300703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.300863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.301007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.301163 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.301314 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.301458 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.301601 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.301760 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.301963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.302132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.302287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.302287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.302579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.302774 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.302924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.303077 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.303278 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.303430 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.303588 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.303743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.303897 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.304129 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.304274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.304417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.304417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.305537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.305693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.305838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.305989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.306139 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.306282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.306424 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.306696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.306948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.307108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.307334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.307488 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.307683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.307683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.307983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.308126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.308268 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.308426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.308583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.308739 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.308894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.309043 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.309198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.309349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.309503 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.309654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.309808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.309953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.310096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.310247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.310391 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.310551 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.310713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.311119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.311329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.311487 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.311637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.311781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.311922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.312072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.312222 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.312373 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.312516 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.312666 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.312818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.312969 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.313111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.313310 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.313468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.313613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.313763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.313907 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.314064 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.314207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.314348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.314503 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.314648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.315833 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.316040 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.316186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.316330 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.316480 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.316632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.316775 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.316949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.317207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.317357 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.317500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.317652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.317804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.317969 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.318123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.318267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.318985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.319138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.319320 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.319474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.319618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.319916 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.320063 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.320208 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.320366 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.320537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.320697 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.320841 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.320983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.321124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.321289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.321441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.321584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.321736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.321879 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.322022 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.322177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.322321 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.322482 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.322625 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.322776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.322776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.323067 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.323260 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.323464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.323624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.323768 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.323923 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.324074 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.324218 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.324360 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.324514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.324664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.324821 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.325118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.326011 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.326167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.326320 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.326512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.326678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.326831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.326974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.327124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.327388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.327559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.327714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.327866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.328028 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.328313 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.328485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.328727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.328877 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.329028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.329186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.329342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.329500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.329644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.329805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.329999 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.330154 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.330308 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.330476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.330621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.330764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.330913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.331064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.331256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.331416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.331569 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.331731 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.331882 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.332032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.332185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.332328 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.332477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.332628 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.332772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.332922 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.333074 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.333218 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.333369 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.333562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.333728 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.333873 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.334729 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.334883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.335034 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.335293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.335623 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.336180 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.336342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.336495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.336639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.336790 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.336933 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.337105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.337250 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.337410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.337625 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.337774 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.337928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.338086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.338239 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.338391 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.338541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.338684 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.338832 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.338988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.339215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.339367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:32:09.339510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.339651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.339818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.339961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.340112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.340255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.340408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.340558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.340710 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.340859 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.341027 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.341179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.341321 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.341471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.341627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.341771 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.341913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.342054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.342197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.342197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.342485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.342629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.342778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.342940 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.343092 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.343274 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.343419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.343610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.343759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.343910 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.344059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.344206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.344355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.344495 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.344640 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.344778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.344933 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.345085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.345232 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.345408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.345583 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.345676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.345777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.346134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.346382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.346479 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.346571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.346664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.346757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.346849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.346932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347114 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347628 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347628 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.347797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.348042 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.348132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.348216 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.348330 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.348330 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.348646 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.348741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.348833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.348916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349008 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349092 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349182 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349266 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349347 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349556 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349664 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.349933 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350017 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350113 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.350463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.351084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.351084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.351084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.351084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.351084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.351084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.351617 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.351733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.352039 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.352375 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.352684 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.352994 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.353766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.353766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.353947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.354195 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.354503 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.354807 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.355130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.355463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.355769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.355914 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.356270 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.356423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.356651 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.356802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.356974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.357152 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.357298 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.357574 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.357715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.357883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.358118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.358252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.358493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.358717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.358851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.359099 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.359271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.359505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.359647 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.359872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.360054 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.360217 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.360525 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.360693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.360968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.361117 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.361425 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.361572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.361746 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.361930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.362076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.362367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.362501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.362674 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.362884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.363031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.363311 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.363453 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.363591 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.364303 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.364452 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.364584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.364803 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.364943 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.365074 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.365244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.365244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.365501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.365681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.365987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.366137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.366585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.366585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.366855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.366986 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.367114 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.367259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.367500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.367704 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.367855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.368081 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.368215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.368405 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.368640 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.368881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.369033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.369310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.369482 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.369650 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.369818 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.369984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.370157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.370316 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.370477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.370636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.370794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.370967 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.371127 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.371378 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.371553 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.371712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.371871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.372040 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.372311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.372504 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.372674 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.372839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.373005 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.373226 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.373986 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.373986 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.374334 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.374494 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.374653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.374823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.374990 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.375165 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.375165 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.375465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.375610 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.375610 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.375876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.376090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.376090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.376370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.376711 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.376711 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.377937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.378089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.378089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.378347 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.378489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.378620 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.378749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.378893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.379094 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.379243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.379388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.379388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.379642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.379779 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.379908 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.380045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.380045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.380307 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.380475 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.380475 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.381369 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.381549 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.381690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.381969 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.382152 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.382284 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.382423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.382569 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.382708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.382976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.383113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.383351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.383494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.383665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.383977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.384118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.384282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.384472 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.384605 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.384891 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.385034 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.385196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.385400 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.385544 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.385796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.386004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.386252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.386499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.386894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.387030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.387196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.387332 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.387461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.387602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.387733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.388018 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.388175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.388314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.388499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.388650 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.388857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.388989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.389152 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.389410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.389548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.389786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.389918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.390091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.390322 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.390466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.390709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.390861 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.391006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.391257 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.391395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.391640 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.391948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.392091 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.392269 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.392527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.392663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.393062 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.393229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.393361 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.393506 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.393639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.393769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.393951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.394078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.394367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.394509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.394676 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.394953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.395098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.395433 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.395578 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.395740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.395927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.396061 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.396355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.397397 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.397639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.397790 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.397992 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.398278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.401156 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.401304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.401461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.401746 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.401895 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.402079 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.402227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.402370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.402501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.402631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.402771 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.402905 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.403044 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.403214 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.403537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.403681 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.403814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.403953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.404189 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.404189 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.404448 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.404578 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.404723 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.404933 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.404933 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.405212 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.405351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.405351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.405604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.405734 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.405734 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.405734 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.405734 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.406231 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.406376 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.406376 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.406864 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.407020 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.407020 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.407740 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.407889 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.408022 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.408166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.408166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.408166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.408561 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.408788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.408932 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.409064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.409064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.409320 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.409450 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.409589 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.409729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.409729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.409991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.410123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.410123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.410465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.410858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.410858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.411032 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.411122 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.411122 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.411436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.411535 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.411620 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.411703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.411703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.411703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.412937 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.413086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.413205 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.413205 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.413569 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.413677 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.413775 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.413870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.413954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.414122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.414225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.414472 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.414577 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.414781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.414881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.415086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.415203 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.415415 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.415521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.415724 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.415818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.416031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.416125 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.416333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.416435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.416646 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.416785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.416950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.417095 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.417266 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.417444 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.417596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.417928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.418033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.418122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.418227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.418338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.418447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.418743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.418908 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.419056 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.419166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.419382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.419537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.419687 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.419851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.420003 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.420150 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.420291 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.420449 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.420611 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.420751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.420902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.421051 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.421190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.421330 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.421477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.421621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.421785 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.421930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.422070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.422216 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.422356 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.422504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.422642 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.422787 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.422926 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.423068 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.423296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.423457 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.423670 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.423808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.423982 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.424090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.424319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.424441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.424578 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.424750 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.424853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.424941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.425282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.425406 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.425536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.425644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.425849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.425941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.426159 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.426256 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.426466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.426577 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.426773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.426893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.427076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.427244 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.427445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.427550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.428355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.428463 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.428845 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.428961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.429162 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.429276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.429477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.429593 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.429807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.429911 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.430118 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.430228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.430425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.430535 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.430732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.430845 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.431034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.431215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.431374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.431487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.431683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.431779 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.431997 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.432091 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.432299 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.432407 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.432605 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.432698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.432928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.433028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.433238 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.433341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.433548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.433641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.433869 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.433970 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.434189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.434289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.434507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.434609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.434810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.434904 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.435116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.435338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.435471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.435615 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.435747 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.436103 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.436348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.436485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.436711 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.436867 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.437061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.437190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.437316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.437431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.437604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.437751 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.437977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.438107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.438232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.438345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.438635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.438777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.438901 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.439028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.439271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.439402 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.439516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.439629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.439844 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.439980 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.440152 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.440289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.440459 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.440589 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.440791 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.440930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.441066 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.441196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.441375 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.441504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.441677 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.441893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.442011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.442128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.442318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.442439 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.442629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.442750 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.442964 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.443102 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.443339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.443492 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.443930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.444018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.444092 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.444248 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.444384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.444562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.444718 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.444871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.445191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.445321 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.445506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.445641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.445848 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.445941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.446158 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.446261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.446513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.446658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.446805 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.446899 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.447128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.447280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.447603 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.447733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.447815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.447952 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.448301 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.448416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.448665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.449046 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.449135 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.449208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.449354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.449446 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.449696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.449801 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.449940 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.450122 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.450236 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.450453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.450722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.450810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.450883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.451255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.451392 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.451570 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.451657 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.451767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.452001 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.452115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.452347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.452678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.452777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.453012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.453181 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.453325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.453505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.453644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.453973 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.454158 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.454303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.454462 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.454604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.454750 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.454891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.455039 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.455271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.455430 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.455575 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.455712 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.455871 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.456049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.456209 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.456352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.456494 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.456645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.456785 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.456932 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.457080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.457192 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.457355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.457477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.457672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.457778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.457991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.458097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.458301 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.458401 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.458627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.458740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.459003 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.459235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.459400 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.459551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.459657 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.459883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.460044 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.460237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.460339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.460540 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.460637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.460851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.460946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.461162 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.461266 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.461466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.461560 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.461772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.461877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.462113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.462228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.462433 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.462539 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.462736 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.462841 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.463045 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.463143 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.463386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.463496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.463699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.463794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.464015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.464118 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.464319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.464502 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.464629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.464770 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.464937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.465039 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.465240 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.465347 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.465543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.465646 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.465844 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.465939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.466168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.466271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.466481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.466575 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.466800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.466894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.467122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.467247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.467466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.467601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.467796 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.467893 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.468111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.468254 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.468421 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.468733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.469060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.469422 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.469590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.469808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.469970 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.470126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.470271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.470462 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.470626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.470785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.470931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.471098 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.471307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.471472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.471617 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.471771 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.471917 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.472061 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.472206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.472361 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.472515 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.472661 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.472810 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.472949 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.473101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.473258 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.473410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.473558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.473699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.473839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.473988 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.474157 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.474298 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.474441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.475131 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.475398 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.475584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.475733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.475884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.476030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.476182 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.476328 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.476483 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.476624 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.476858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.477011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.477201 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.477353 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.477517 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.477666 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.477814 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.477954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.478106 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.478252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.478408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.478558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.478736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.478918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.479079 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.479293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.479520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.479683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.479830 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.479974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.480164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.480327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.480474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.480619 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.480789 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.480938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.481109 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.481262 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.481429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.481596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.481748 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.481850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.482069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.482385 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.482489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.482703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.482806 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.483020 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.483124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.483360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.483454 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.483685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.483779 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.484000 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.484252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.484347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.484582 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.484684 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.484897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.484991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.485201 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.485298 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.485497 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.485593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.485813 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.485915 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.486127 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.486228 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.486440 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.486541 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.486751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.486854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.487064 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.487177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.487403 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.487514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.487718 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.487826 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.488032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.488136 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.488358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.488459 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.488690 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.488784 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.488996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.489091 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.489311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.489455 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.489623 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.489752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.489936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.490078 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.490806 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.491024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.491290 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.491458 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.491607 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.491773 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.491921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.492094 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.492232 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.492413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.492541 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.492738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.492839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.493109 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.493234 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.493366 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.493461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.493682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.493786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.494000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.494096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.494313 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.494408 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.494624 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.494743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.494938 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.495034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.495279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.495519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.495616 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.495831 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.495936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.496164 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.496268 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.496487 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.496597 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.496810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.496918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.497122 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.497218 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.497484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.497658 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.497777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.497978 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.498164 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.498404 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.498516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.498610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.498779 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.498936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.499130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.499279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.499459 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.499818 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.502072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.502259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.502389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.502518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.502654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.502780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.502896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.503012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.503012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.503292 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.503425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.503552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.503668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.503794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.503909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.504034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.504164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.504164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.504376 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.504490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.504602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.504717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.504839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.504839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.505075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.505197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.505311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.505439 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.505553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.505666 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.505666 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.505924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.506059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.506183 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.506296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.506410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.506508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.506583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.506759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.506937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.507082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.507261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.507428 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.507567 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.507736 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.507890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.508121 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.508275 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.508451 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.508604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.508758 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.508902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.509050 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.509149 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.509345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.509441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.509646 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.509806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.510066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.510210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.510313 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.510445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.510577 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.510752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.510858 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.511074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.511253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.511466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.511791 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.511896 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.511990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.512078 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.512169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.512363 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.512466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.512668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.512799 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.512980 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.513155 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.513329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.513637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.513740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.513948 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.514050 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.514255 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.514367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.514566 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.514743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.514896 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.515067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.515259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.515446 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.515674 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.515855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.516020 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.516229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.516341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.516588 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.516772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.516918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.517124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.517230 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.517459 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.517622 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.517925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.518127 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.518244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.518480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.518592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.518800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.518903 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.519251 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.519383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.519557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.519734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.519892 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.520070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.520230 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.520376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.520544 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.520699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.520854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.521004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.521145 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.521288 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.521468 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.521696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.521845 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.522047 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.522200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.522349 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.522510 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.522655 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.522796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.522978 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.523130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.523342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.523485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.523635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.523777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.523919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.524060 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.524237 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.524383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.524537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.524679 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.524851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.524997 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.525152 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.525300 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.525442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.525585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.525764 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.525922 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.526070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.526214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.526377 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.526520 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.526799 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.527029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.527029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.527336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.527477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.527628 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.527772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.527923 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.528073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.528173 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.528267 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.528363 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.528510 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.528620 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.528841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.528946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.529157 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.529252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.529463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.529558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.529788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.529892 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.530120 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.530223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.530439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.530577 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.530748 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.530851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.531098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.531240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.531445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.531547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.531769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.531871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.532080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.532184 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.532402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.532504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.532717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.532820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.533045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.533149 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.533358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.533450 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.533681 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.533820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.533995 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.534141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.534301 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.534395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.534606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.534702 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.534909 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.535012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.535321 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.535420 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.535633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.535727 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.535942 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.536046 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.536248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.536349 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.536551 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.536654 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.536861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.537011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.537741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.538057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.538057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.538320 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.538455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.538635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.538783 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.538942 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.539041 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.539274 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.539389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.539585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.539687 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.539893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.539995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.540196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.540298 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.540498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.540654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.540803 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.540932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.541110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.541235 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.541546 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.541884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.542192 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.542359 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.542517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.542664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.542820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.542967 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.543112 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.543333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.543484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.543637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.543792 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.543937 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.544088 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.544243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.544397 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.544548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.544695 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.544840 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.544990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.545100 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.545440 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.545763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.546111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.546401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.546508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.546725 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.546821 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.547038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.547236 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.547393 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.547507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.547715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.547809 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.548030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.548132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.548343 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.548446 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.548666 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.548762 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.548975 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.549076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.549288 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.549392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.549599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.549694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.549910 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.550013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.550220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.550364 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.550530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.550626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.550856 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.550960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.551203 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.551359 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.551525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.551845 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.552167 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.552559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.552705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.553390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.553507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.553731 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.553936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.554069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.554265 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.554399 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.554583 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.554722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.554898 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.555065 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.555253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.555408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.555576 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.555725 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.555887 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.556038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.556204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.556354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.556524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.556689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.556842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.557001 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.557154 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.557296 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.557473 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.557619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.557780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.557923 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.558097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.558251 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.558424 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.558565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.558791 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.558887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.559096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.559305 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.559450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.559555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.559781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.559887 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.560133 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.560228 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.560442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.560555 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.560748 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.561154 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.561301 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:32:09.561395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.561673 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.561985 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.562291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:32:09.562535 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:32:09.625068 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO dbcounter [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Registered counter for database nova_api Sep 01 16:32:09.625419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO dbcounter [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Registered counter for database nova_api Sep 01 16:32:09.647087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_db.sqlalchemy.engines [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:32:09.649791 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_db.sqlalchemy.engines [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:32:09.656740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writer thread running {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:32:09.657759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writer thread running {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:32:09.716920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.context [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82d7d12e-bed5-49fc-8bd1-b3172eaca82c(cell1) {{(pid=127531) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:32:09.720997 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.721481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.723052 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:09.723459 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.context [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82d7d12e-bed5-49fc-8bd1-b3172eaca82c(cell1) {{(pid=127532) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:32:09.723803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.724245 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.727388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:09.728392 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.728876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.729398 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO dbcounter [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Registered counter for database nova_cell0 Sep 01 16:32:09.730464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:09.731221 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.731669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.733653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:09.733849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO dbcounter [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Registered counter for database nova_cell1 Sep 01 16:32:09.735703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO dbcounter [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Registered counter for database nova_cell0 Sep 01 16:32:09.740981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO dbcounter [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Registered counter for database nova_cell1 Sep 01 16:32:09.748238 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_db.sqlalchemy.engines [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:32:09.749151 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_db.sqlalchemy.engines [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:32:09.749274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_db.sqlalchemy.engines [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:32:09.750443 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_db.sqlalchemy.engines [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:32:09.757766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writer thread running {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:32:09.758151 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writer thread running {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:32:09.759578 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writer thread running {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:32:09.906302 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writer thread running {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:32:09.915205 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO dbcounter [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Registered counter for database nova_cell0 Sep 01 16:32:09.917539 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO dbcounter [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Registered counter for database nova_cell0 Sep 01 16:32:09.922346 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_db.sqlalchemy.engines [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:32:09.925862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_db.sqlalchemy.engines [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:32:09.927049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writer thread running {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:32:09.930960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writer thread running {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:32:10.259201 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: WARNING keystonemiddleware.auth_token [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:32:10.260446 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: WARNING keystonemiddleware.auth_token [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:32:10.266556 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: WARNING keystonemiddleware.auth_token [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:32:10.267701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: WARNING keystonemiddleware.auth_token [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:32:10.617071 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: WARNING keystonemiddleware.auth_token [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:32:10.623354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: WARNING keystonemiddleware.auth_token [None req-3b8efd79-bbb8-44a3-b973-c1b1319440ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:32:10.627971 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: WARNING keystonemiddleware.auth_token [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:32:10.628637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584399799c0 pid: 127532 (default app) Sep 01 16:32:10.635066 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: WARNING keystonemiddleware.auth_token [None req-92d0bea4-acb1-4736-b365-78bbaaccd3aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:32:10.640346 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584399799c0 pid: 127531 (default app) Sep 01 16:33:03.489066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=3 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:03.493745 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=3 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:03.498142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=3 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:03.499525 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=3 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:04.265607 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1036031245", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:04.894810 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] validate_networks() for [('33d75bfb-4975-48d5-980c-d407446050dc', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:33:07.031294 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:07.041378 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:07.044424 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:07.045242 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:07.522856 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:33:07.523965 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:33:07.524598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:33:07.525166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:33:07.525838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:33:07.551492 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:07.554088 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:07.555550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:07.557927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:07.558585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:07.559585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:07.648201 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Getting quotas for project 2f0958b1518e4439bf12959b7760abc4. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:07.662527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Getting quotas for user 8937e9f80f1540e389ee283971624741 and project 2f0958b1518e4439bf12959b7760abc4. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:07.697442 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:33:07.715527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:33:07.815874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8668adab-2706-4bab-9b5e-8074fc07e83e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: .version_select at 0x7fe37afb44c0>, body: {"keypair": {"name": "tempest-keypair-1417858930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBwDUHahJqac50cllbY10VIYPMllcJDq55dOEGMP8gbfksTG4s8VlFblfzGjrlQqEkxia6OjPoWU0Zfhfy9LxsGFMAG0VgDeFoiORSYpyb9KuJCkj9lkIRiL8/3FhfhIg=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:08.041477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-558fb8a1-5bb6-49ff-9dad-7873aa1468a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.573771 Sep 01 16:33:08.042272 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:33:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 4576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:33:08.057062 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-00f6d2e0-bc39-4891-8e8d-c0842f012a79 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:08.057716 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-00f6d2e0-bc39-4891-8e8d-c0842f012a79 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:08.092814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-8668adab-2706-4bab-9b5e-8074fc07e83e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for project a994270b8e1f43328b827696f9d89bb0. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:08.123874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-8668adab-2706-4bab-9b5e-8074fc07e83e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for user 8a45ee95cf5947c49584ff403facaff7 and project a994270b8e1f43328b827696f9d89bb0. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:08.328774 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-00f6d2e0-bc39-4891-8e8d-c0842f012a79 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:08.358732 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8668adab-2706-4bab-9b5e-8074fc07e83e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.355165 Sep 01 16:33:08.359099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-00f6d2e0-bc39-4891-8e8d-c0842f012a79 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1222 microversion: 2.1 time: 0.308111 Sep 01 16:33:08.363183 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:33:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:08.368555 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:08 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1222 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:08.481018 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1554880986", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:08.979389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] validate_networks() for [('33d75bfb-4975-48d5-980c-d407446050dc', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:33:09.952504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1309459971", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "networks": [{"uuid": "60a9a823-6b0c-4651-9fcc-dd23f02024ba"}]}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:10.070646 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] validate_networks() for [('60a9a823-6b0c-4651-9fcc-dd23f02024ba', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:33:11.088733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:33:11.090651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:33:11.090651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:33:11.090651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:33:11.090651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:33:11.114194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:11.118871 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:11.121275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:11.124714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:11.136680 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:11.136680 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:11.169733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Getting quotas for project 2f0958b1518e4439bf12959b7760abc4. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:11.174498 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Getting quotas for user 8937e9f80f1540e389ee283971624741 and project 2f0958b1518e4439bf12959b7760abc4. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:11.191047 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:33:11.197281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:33:11.289907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:33:11.290493 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:33:11.290919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:33:11.291359 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:33:11.291765 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:33:11.318169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:11.318849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:11.319345 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:11.320254 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:11.320862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:11.321550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:11.354920 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Getting quotas for project c504a04e6b84427b9732157524a4aeef. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:11.359378 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Getting quotas for user 662f85837db7411e8695d971413fc5ba and project c504a04e6b84427b9732157524a4aeef. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:11.373834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:33:11.376596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:33:11.418620 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-00fd8118-c896-4696-a03f-ea70680e2e84 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.943339 Sep 01 16:33:11.426104 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 2/4] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:33:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:33:11.606293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fe6d6122-9c9a-4bbd-97d7-04af7c4e0caa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'create', calling method: .version_select at 0x7fe37ad65670>, body: {"keypair": {"name": "tempest-keypair-1062091439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOypExgQiWGgxKGzDT/4o+XHy39oqArAbjUIdknia12wWicG9NaObhcncM+UcJprLtnx2H2gy2nFLY28wsGj2F+ijlh7wqGERtdiu2q5UIpyJ8AhcevOqBb4nnc+xqorA=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:11.648591 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-fe6d6122-9c9a-4bbd-97d7-04af7c4e0caa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Getting quotas for project b14e9793530a41bbab5bd4b3caecdb3c. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:11.663472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-fe6d6122-9c9a-4bbd-97d7-04af7c4e0caa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Getting quotas for user ab4df1724851433889a519583a5333b3 and project b14e9793530a41bbab5bd4b3caecdb3c. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:11.712431 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5861b01f-5946-4d2a-98cb-9c5f126e31c5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.938468 Sep 01 16:33:11.724841 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 3/5] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:33:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:33:11.888367 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-829f1d1c-7fb1-44e0-8663-60f4c46cb199 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'create', calling method: .version_select at 0x7fe37a575040>, body: {"keypair": {"name": "tempest-keypair-2100385934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZQ8ftHDx6dc+BYjWJj6TZTv7Hvg5yOU5E+Usgshq7b3RxlrrdIRWddj/Rip9IRRKz7S75QQtNu8pRYgYCeoH7dwleGQX4fBfH/mbeNC1O3gfojkVhXsE6d5s+qxq0m/w=="}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:11.950251 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fe6d6122-9c9a-4bbd-97d7-04af7c4e0caa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.522198 Sep 01 16:33:11.951286 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 3/6] 10.222.0.16 () {62 vars in 1200 bytes} [Thu Sep 1 16:33:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 524 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 16:33:11.952801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-829f1d1c-7fb1-44e0-8663-60f4c46cb199 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Getting quotas for project c787c684c86144c792d9afc457ac3212. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:11.964245 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-33a1b3a9-958b-4ac0-b378-7e8fd42a9575 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:11.965151 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-33a1b3a9-958b-4ac0-b378-7e8fd42a9575 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:11.974595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-829f1d1c-7fb1-44e0-8663-60f4c46cb199 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Getting quotas for user 21e6ff7908e84a5994a51be0cfc82414 and project c787c684c86144c792d9afc457ac3212. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:12.176686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-829f1d1c-7fb1-44e0-8663-60f4c46cb199 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.450325 Sep 01 16:33:12.178200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 4/7] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:33:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:12.184549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8b7d43c8-23ab-4fe8-8173-88bb03514df8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:12.185177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8b7d43c8-23ab-4fe8-8173-88bb03514df8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:12.303603 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-33a1b3a9-958b-4ac0-b378-7e8fd42a9575 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:12.350167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8b7d43c8-23ab-4fe8-8173-88bb03514df8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:12.358107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8b7d43c8-23ab-4fe8-8173-88bb03514df8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1215 microversion: 2.1 time: 0.178710 Sep 01 16:33:12.364157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:12 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:12.364445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-33a1b3a9-958b-4ac0-b378-7e8fd42a9575 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1222 microversion: 2.1 time: 0.410840 Sep 01 16:33:12.365900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 4/9] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:11 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1222 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:13.383590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-59ec9381-c643-42df-be70-c36da121bc40 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:13.383590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-59ec9381-c643-42df-be70-c36da121bc40 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:13.389669 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-208e2aac-eb34-4901-b3dc-c517a727ce77 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:13.390430 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-208e2aac-eb34-4901-b3dc-c517a727ce77 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:13.575323 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-59ec9381-c643-42df-be70-c36da121bc40 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:13.583086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-59ec9381-c643-42df-be70-c36da121bc40 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1215 microversion: 2.1 time: 0.205501 Sep 01 16:33:13.586162 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:13 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:13.637238 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-208e2aac-eb34-4901-b3dc-c517a727ce77 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:13.646592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-208e2aac-eb34-4901-b3dc-c517a727ce77 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1222 microversion: 2.1 time: 0.261101 Sep 01 16:33:13.660437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:13 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1222 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:14.296935 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1024967807", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1eb71281-5889-42b9-a660-ae574bf041ed"}], "security_groups": [{"name": "tempest-securitygroup--555364405"}], "key_name": "tempest-keypair-1417858930", "user_data": "}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:14.518782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] validate_networks() for [('1eb71281-5889-42b9-a660-ae574bf041ed', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:33:14.614151 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:14.614969 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:14.633842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:14.634862 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:14.635487 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:14.643026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:14.643749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:14.644422 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.039608 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:15.054556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da867bb2-774d-418d-a156-327580f6f5d1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1219 microversion: 2.1 time: 0.444310 Sep 01 16:33:15.055868 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:14 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1219 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:15.078000 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:15.087283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:15.109808 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.119983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.119983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.119983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.119983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.120842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.299019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:33:15.299545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:33:15.300041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:33:15.300424 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:33:15.300831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:33:15.320823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.321567 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.322751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.324612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.325580 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.327096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.388124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for project a994270b8e1f43328b827696f9d89bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:15.398205 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for user 8a45ee95cf5947c49584ff403facaff7 and project a994270b8e1f43328b827696f9d89bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:15.431200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:33:15.436043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:33:15.554958 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:15.576363 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6077e3c4-d633-46aa-86bf-41feac1153f5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1226 microversion: 2.1 time: 0.519113 Sep 01 16:33:15.576956 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:15 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1226 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:15.614180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-41e953c0-f7ed-4dcb-aa0d-4df5b2fc92d2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.324389 Sep 01 16:33:15.620525 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 7/14] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:33:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:33:15.632193 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e6640848-8626-4fa1-a900-3314d3c90cdb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:15.633374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e6640848-8626-4fa1-a900-3314d3c90cdb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:15.733010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e6640848-8626-4fa1-a900-3314d3c90cdb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:15.745154 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e6640848-8626-4fa1-a900-3314d3c90cdb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1242 microversion: 2.1 time: 0.117666 Sep 01 16:33:15.745813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:15 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:16.080085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:16.081620 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:16.097429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.097931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.098511 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.100285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.100749 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.101218 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.337830 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:16.355633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f2e9a462-e05f-45b5-bd23-cfc2685f8afb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1267 microversion: 2.1 time: 0.281621 Sep 01 16:33:16.356845 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:16 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:16.598248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:16.599682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:16.607036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.608347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.608863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.609621 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.610076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.611383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.770431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:16.771956 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c39cd7db-7275-4ac6-adca-2b25f463290f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:16.772602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c39cd7db-7275-4ac6-adca-2b25f463290f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:16.781442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e16906ee-902e-4073-b3fa-8722c395172d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1274 microversion: 2.1 time: 0.187262 Sep 01 16:33:16.782287 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 9/17] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:16 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:16.887928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c39cd7db-7275-4ac6-adca-2b25f463290f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:16.896585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c39cd7db-7275-4ac6-adca-2b25f463290f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1242 microversion: 2.1 time: 0.128391 Sep 01 16:33:16.897645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 9/18] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:16 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:17.305324 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-835136576", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c77ef22c-addf-4317-8f69-06a58732469c"}], "security_groups": [{"name": "tempest-securitygroup--2127393389"}], "key_name": "tempest-keypair-1062091439", "user_data": "}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:17.385339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:17.385971 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:17.393263 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:17.394282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:17.394752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:17.395504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:17.396123 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:17.396992 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:17.500349 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:17.522029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-25eebfaf-3df0-46f5-881c-b653dbc96530 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1267 microversion: 2.1 time: 0.146990 Sep 01 16:33:17.523794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] validate_networks() for [('c77ef22c-addf-4317-8f69-06a58732469c', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:33:17.524596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 10/19] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:17 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:17.574922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1281149204", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34674731-e9de-430b-8790-1c8cae27644d"}], "security_groups": [{"name": "tempest-securitygroup--1729312167"}], "key_name": "tempest-keypair-2100385934", "user_data": "}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:17.709111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] validate_networks() for [('34674731-e9de-430b-8790-1c8cae27644d', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:33:18.175377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:33:18.175867 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:33:18.176313 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:33:18.177816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:33:18.178584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:33:18.188698 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.189526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.190107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.191004 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.191620 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.192204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.212317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Getting quotas for project b14e9793530a41bbab5bd4b3caecdb3c. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:18.218516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Getting quotas for user ab4df1724851433889a519583a5333b3 and project b14e9793530a41bbab5bd4b3caecdb3c. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:18.232879 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:33:18.235180 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:33:18.354238 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:33:18.354645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:33:18.354918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:33:18.355356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:33:18.355767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:33:18.365122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.365705 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.366145 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.366928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.367340 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.367758 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.406419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Getting quotas for project c787c684c86144c792d9afc457ac3212. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:18.406419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Getting quotas for user 21e6ff7908e84a5994a51be0cfc82414 and project c787c684c86144c792d9afc457ac3212. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:18.415921 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:33:18.419937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:33:18.442457 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ce3a7d8c-8328-4b1c-9fcc-fdff01883e63 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.142123 Sep 01 16:33:18.447573 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 10/20] 10.222.0.16 () {62 vars in 1188 bytes} [Thu Sep 1 16:33:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 16:33:18.451644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:18.452551 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:18.453447 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:18.459097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.459692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.460123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.460834 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.461297 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.461804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.544176 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8f96b0de-6651-44ce-bcf4-5d8b041d8bcd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.984856 Sep 01 16:33:18.545209 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 11/21] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:33:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:33:18.551682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:18.555171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:18.565504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.566702 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.567484 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.568709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.569374 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.570332 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.595686 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:18.636412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e9579984-f14c-4908-963d-9963e309e808 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1274 microversion: 2.1 time: 0.182158 Sep 01 16:33:18.636412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 11/22] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:18 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:18.636412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7e2eae2a-23ea-46b2-8e30-23fca339d66c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:18.636412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7e2eae2a-23ea-46b2-8e30-23fca339d66c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:18.697947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:18.707369 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-47913e01-1ed5-461b-8b05-1dcaf0507e2a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1246 microversion: 2.1 time: 0.160892 Sep 01 16:33:18.708898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:18 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1246 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:18.720289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:18.724605 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:18.748830 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.752900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.752900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.752900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.752900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.753370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.790516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7e2eae2a-23ea-46b2-8e30-23fca339d66c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:18.798678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7e2eae2a-23ea-46b2-8e30-23fca339d66c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:18.800166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7e2eae2a-23ea-46b2-8e30-23fca339d66c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:18.804045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7e2eae2a-23ea-46b2-8e30-23fca339d66c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1281 microversion: 2.20 time: 0.172570 Sep 01 16:33:18.805185 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 12/24] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:18 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:18.809725 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c4f31c68-68ea-42a5-bad5-9067f1a575fa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:18.810335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c4f31c68-68ea-42a5-bad5-9067f1a575fa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:18.870450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:18.879268 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f801a609-36bd-4bf4-8229-564a0f2b6122 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1267 microversion: 2.1 time: 0.169284 Sep 01 16:33:18.880770 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:18 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:18.891776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c4f31c68-68ea-42a5-bad5-9067f1a575fa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:18.900236 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c4f31c68-68ea-42a5-bad5-9067f1a575fa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1238 microversion: 2.1 time: 0.093980 Sep 01 16:33:18.916502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:18 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:19.659562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:19.660184 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:19.688056 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:19.688056 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:19.688056 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:19.693075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:19.695041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:19.696124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:19.749352 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:19.750277 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:19.766011 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:19.766011 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:19.768668 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:19.785530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:19.787829 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:19.790962 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:19.838061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:19.849127 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-49e70952-e1a1-428a-8443-22cee6053e5f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1274 microversion: 2.1 time: 0.193857 Sep 01 16:33:19.849739 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:19 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:19.855001 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8fe366f5-94c9-4acc-8f99-626054bd49a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:19.855517 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8fe366f5-94c9-4acc-8f99-626054bd49a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:19.892770 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:19.902591 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e8e58509-efd9-43af-93e5-79041579bd9d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1238 microversion: 2.1 time: 0.162731 Sep 01 16:33:19.904994 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:19 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1238 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:19.910112 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:19.910948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:19.927673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:19.928641 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:19.929227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:19.930240 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:19.930762 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:19.931222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:19.955003 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8fe366f5-94c9-4acc-8f99-626054bd49a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:19.965562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8fe366f5-94c9-4acc-8f99-626054bd49a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:19.968237 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8fe366f5-94c9-4acc-8f99-626054bd49a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:19.969698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8fe366f5-94c9-4acc-8f99-626054bd49a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1281 microversion: 2.20 time: 0.118763 Sep 01 16:33:19.970478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 15/29] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:19 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1281 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:19.977110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-00cee54c-5af9-421f-a9a9-287f9c33b90f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:19.977731 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-00cee54c-5af9-421f-a9a9-287f9c33b90f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:20.019846 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:20.027945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c661f9f5-6f7f-41d5-ab61-d401997acdb8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1267 microversion: 2.1 time: 0.121869 Sep 01 16:33:20.028524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 15/30] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:19 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:20.038456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-00cee54c-5af9-421f-a9a9-287f9c33b90f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:20.046771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-00cee54c-5af9-421f-a9a9-287f9c33b90f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1238 microversion: 2.1 time: 0.074820 Sep 01 16:33:20.047524 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 16/31] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:19 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:20.872259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:20.873754 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:20.883233 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:20.884051 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:20.884728 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:20.885899 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:20.886562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:20.888080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:20.938926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:20.940253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:20.961337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:20.963409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:20.964349 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:20.969680 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:20.971801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:20.978898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:21.142764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:21.154489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9db04232-5596-4629-9ca4-2a443119eb61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1274 microversion: 2.1 time: 0.285681 Sep 01 16:33:21.154489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 16/32] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:20 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:21.166993 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:21.168002 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:21.215391 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:21.216086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:21.217118 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:21.219419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:21.222311 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:21.227707 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:21.233006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:21.261676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3482b20e-75ef-4b44-9ed8-f8cb72bb5fb2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1294 microversion: 2.1 time: 0.324826 Sep 01 16:33:21.264066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 17/33] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:20 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1294 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:21.276146 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:21.289244 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:21.322160 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:21.325707 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:21.326187 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:21.330291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:21.336339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:21.336788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:21.578973 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:21.591880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-116ff400-3ac8-470f-8f44-4f2295c25fae tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1275 microversion: 2.1 time: 0.322064 Sep 01 16:33:21.592899 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 18/34] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:21 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:21.598099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:21.599485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:21.637466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:21.639872 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:21.640527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:21.642651 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:21.645289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:21.646152 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:21.820286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:21.840652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a407510d-f2ef-41e8-bc42-7534b1431e2b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1242 microversion: 2.1 time: 0.246722 Sep 01 16:33:21.846031 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 19/35] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:21 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1242 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:22.088936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:22.101443 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:22.104766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:22.106457 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b3a07ff8-87e9-42f4-aac6-3122e0b97bf6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1277 microversion: 2.20 time: 0.951994 Sep 01 16:33:22.117969 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 17/36] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:21 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1277 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:22.179949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:22.181110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:22.225713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:22.226309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:22.233568 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:22.234339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:22.234881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:22.235238 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:22.305456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:22.305456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:22.305456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:22.305456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:22.306031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:22.306031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:22.306031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:22.306031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:22.512010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:22.523799 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7cfb4dbe-08ac-4093-806c-6574b2b1f8cb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1302 microversion: 2.1 time: 0.237645 Sep 01 16:33:22.526908 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 18/37] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:22 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1302 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:22.622063 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:22.622695 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:22.632801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:22.638275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:22.639214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:22.640364 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:22.642700 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:22.643858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:22.647288 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:22.653595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0b67b278-c7b6-4b45-b2de-876914110e48 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1280 microversion: 2.1 time: 0.481896 Sep 01 16:33:22.671396 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 20/38] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:22 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1280 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:22.830853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:22.842381 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b75fb293-2842-4759-82bb-224a46d7b27a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1273 microversion: 2.1 time: 0.223669 Sep 01 16:33:22.846085 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 19/39] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:22 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:22.868278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:22.870937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:22.880824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:22.881588 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:22.882174 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:22.882998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:22.883904 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:22.884587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:23.023905 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:23.038265 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-eac728ea-18f0-4438-be41-7d91d94e8bad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.176520 Sep 01 16:33:23.040247 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 21/40] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:22 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:23.135472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:23.137100 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:23.146271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:23.153600 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:23.160145 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:23.160938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:23.170126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:23.170126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:23.170126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:23.345835 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:23.358091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:23.359835 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:23.376941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8ea51939-2f84-48fe-94c7-7f516dea7c75 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.231129 Sep 01 16:33:23.377860 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:23 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:23.567190 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:23.568991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:23.579844 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:23.580963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:23.581769 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:23.582840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:23.583587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:23.584361 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:23.689795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:23.690332 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:23.699579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:23.700252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:23.700837 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:23.701747 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:23.704179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:23.704772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:23.774465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:23.793170 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fab8be3d-b6cd-429e-acaf-f5f4abb75577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1302 microversion: 2.1 time: 0.237160 Sep 01 16:33:23.796771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:23 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1302 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:23.833256 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:23.844742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-82449f0b-8f15-4c2f-aedb-69adefc01a8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1280 microversion: 2.1 time: 0.163946 Sep 01 16:33:23.845588 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:23 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:23.877848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:23.878575 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:23.885204 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:23.885680 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:23.886108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:23.886787 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:23.887309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:23.887717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:24.064404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:24.065287 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:24.067884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:24.075328 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:24.076323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:24.076571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-175c3de6-3289-4bac-967e-087dc2f3f111 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.202488 Sep 01 16:33:24.077362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:24.077556 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 23/44] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:23 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:24.080248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:24.080983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:24.081410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:24.156898 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:24.168163 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-682eb9c2-d8b5-4930-b304-ed566ee04eae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.109348 Sep 01 16:33:24.168977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 22/45] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:24 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:24.402187 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:24.402932 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:24.410497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:24.413484 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:24.413932 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:24.414662 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:24.415193 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:24.415855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:24.482466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:24.496084 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:24.501610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:24.502738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-836f7b28-0870-42ab-b912-999e334eaa8e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.104567 Sep 01 16:33:24.503509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:24 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:24.817032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:24.818265 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:24.824643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:24.825102 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:24.825531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:24.826215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:24.826663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:24.827083 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:24.866596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:24.867247 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:24.873732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:24.874204 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:24.874795 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:24.875861 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:24.876303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:24.876908 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:24.888692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:24.896722 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c5cbdd03-ac45-4cb6-ba2f-3eb8b8170544 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1302 microversion: 2.1 time: 0.083840 Sep 01 16:33:24.897386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 23/47] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:24 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:25.011895 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:25.019697 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-af7864e5-fcc8-4f3d-984d-5dff177aa690 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.157678 Sep 01 16:33:25.020281 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:24 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:25.098017 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:25.099211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:25.105431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:25.106207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:25.106977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:25.107717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:25.108222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:25.108622 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:25.189974 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:25.190742 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:25.203325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:25.203811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:25.204236 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:25.204937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:25.205385 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:25.205989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:25.267648 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:25.271679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:25.275645 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1bf68db0-cf18-4b90-9642-146a03600d12 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.181496 Sep 01 16:33:25.276230 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 24/49] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:25 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:25.279406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6e591791-97e5-40b7-aec8-746009566f74 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.093780 Sep 01 16:33:25.280158 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 26/50] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:25 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:25.528268 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:25.528870 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:25.540325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:25.540676 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:25.541102 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:25.542055 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:25.542216 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:25.542632 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:25.613718 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:25.617333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:25.626572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:25.626572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:25.626572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be00cabb-120c-4536-b8d2-6a2ac39b9b7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.100679 Sep 01 16:33:25.626938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:25 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:33:25.918547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:25.919394 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:25.929608 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:25.930121 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:25.930510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:25.931345 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:25.931669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:25.932126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:25.937041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:26.024720 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:26.033779 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-328e0f55-ce89-435c-8ba8-9ab093dfdbd6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1302 microversion: 2.1 time: 0.119409 Sep 01 16:33:26.034532 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:25 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:26.048522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:26.048522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:26.055139 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.055741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.056409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.057188 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.057648 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.058069 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.257527 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:26.268391 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-276d2f82-258f-44e1-a37c-86cadd0d6ed6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.230459 Sep 01 16:33:26.282717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 26/53] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:26 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:26.297862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:26.298839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:26.300250 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:26.301143 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:26.307423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.308235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.308808 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.309131 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.309298 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.309900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.310271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.310906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.311249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.311488 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.311917 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.312290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.410793 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:26.441356 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-482b7f22-d970-460a-aebd-25f3ee9f59bf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.127632 Sep 01 16:33:26.441356 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:26 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:26.523341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:26.523341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-faea7c26-98bd-4ff1-b25e-d1bc05f20714 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.222494 Sep 01 16:33:26.523341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 28/55] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:26 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:26.649282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:26.650164 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:26.656955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.657428 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.657947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.658666 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.659111 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.659587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.742790 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:26.744597 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:26.746038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:26.747139 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0ccdda60-7819-47e1-ac1b-e935fb9c23bc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.103086 Sep 01 16:33:26.747970 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 28/56] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:26 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:27.056956 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:27.057841 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:27.065259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.065742 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.066171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.066866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.067996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.068452 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.269462 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:27.285904 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2a461074-7b52-4c0a-ae19-f5e0b607aba4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.233824 Sep 01 16:33:27.306772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:27.306772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:27.307651 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 29/57] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:27 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:27.311304 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.311898 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.313291 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.314199 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.314664 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.315094 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.448229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:27.456440 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:27.456440 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.456440 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.457053 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.458653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.459492 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.460049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.497921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:27.505453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e05c2ccc-c907-40c6-8b0b-53ec8b5d1d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.218970 Sep 01 16:33:27.507201 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 29/58] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:27 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:27.547182 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:27.549625 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:27.557925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:27.569405 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2ca5d5e7-4d35-4e9b-b4d0-77d942580396 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.125088 Sep 01 16:33:27.570253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.583639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:27 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:27.583827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.583827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.583827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.583827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.584116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.772030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:27.772913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:27.784617 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.786945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.787488 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.789893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.791467 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.792296 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.837957 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:27.847899 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3efeb541-cf15-4e4e-a2bf-6aa8d75e62a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.313461 Sep 01 16:33:27.863514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 30/60] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:27 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:27.902155 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:27.918838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:27.920460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:27.921702 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-52bbaf5f-5d65-4a21-b8c7-aba01e85f0e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.155565 Sep 01 16:33:27.922389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:27 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:33:28.314780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:28.315701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:28.317988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:28.326573 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.327461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.328034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.329705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.329705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.330584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.418051 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:28.425896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6c71da3b-f743-4708-ade0-c517fcca32da tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.115340 Sep 01 16:33:28.446200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 31/62] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:28 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:28.543527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:28.544130 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:28.546104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=8 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:28.551353 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.551916 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.552902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.553755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.554277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.554695 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.598404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:28.599888 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:28.618870 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.620694 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.623401 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.623567 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.625918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.626449 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.707243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:28.735257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e733d846-8744-498e-958e-fba98b6dae02 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.140476 Sep 01 16:33:28.746759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:28 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:28.748011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:28.765472 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-37236565-46a2-4660-a87c-a1f7ea30a7c4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.225046 Sep 01 16:33:28.767085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 32/64] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:28 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:28.870988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:28.871644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:28.880076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.880281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.880835 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.881399 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.881854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.899179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.899179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=30 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:28.946631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:28.947427 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:28.960247 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.968177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.969512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.970475 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.971303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.971949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.076316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:29.085568 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:29.088425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:29.089771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c66c2bf7-f215-4fc0-bbaa-37699c8032e8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.148530 Sep 01 16:33:29.090828 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:28 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:29.158196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:29.168680 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-497f57d1-130e-48c1-a86c-8a3b8af1f5aa tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.301569 Sep 01 16:33:29.182869 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:28 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:29.463077 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:29.465439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:29.480382 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:29.486198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:29.486198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.486198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:29.486198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:29.486520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.600474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:29.620050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2a420cd3-3380-4aa3-9a51-179f062a6421 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.168776 Sep 01 16:33:29.620648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:29 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:29.762555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:29.765680 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:29.773220 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:29.773788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:29.774204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.775103 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:29.775603 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:29.776031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.804074 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:29.805977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:29.824835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:29.826573 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:29.834423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.837481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:29.839992 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:29.844193 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.875914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:29.892729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-de6a0a81-9cad-465d-8029-f34c3f1e6fd5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.138241 Sep 01 16:33:29.893382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 34/68] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:29 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:30.047177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=40 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:30.125580 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:30.126284 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:30.135057 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:30.135687 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:30.136178 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:30.136975 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:30.137660 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:30.138283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:30.187318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:30.204671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2a5b7e51-1d09-4e0f-a731-4a727eb14f41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.413694 Sep 01 16:33:30.222870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 35/69] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:29 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:30.230644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:30.231557 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:30.238502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:30.239795 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:30.240636 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:30.244972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:30.247054 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:30.247840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:30.248647 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:30.252107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:30.255900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:30.258773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9fc85c16-63fd-4429-acb2-f79cbbb1974a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.138438 Sep 01 16:33:30.270909 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:30 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:30.487345 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:30.497792 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-166db3a6-0e27-4da7-9ea0-95f0cd7e94e7 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.271971 Sep 01 16:33:30.504235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 36/71] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:30 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:30.653252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:30.653922 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:30.660792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:30.661430 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:30.661911 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:30.662741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:30.663344 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:30.663770 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:30.754655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:30.763380 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6b00f746-2a22-42e9-b912-522af8a33da2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.113800 Sep 01 16:33:30.764032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 36/72] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:30 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:30.924794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:30.925408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:30.940406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:30.941684 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:30.942131 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:30.943052 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:30.943655 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:30.944105 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.033395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:31.043115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0016f0d1-8e12-4632-b087-0a2d12864699 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.132266 Sep 01 16:33:31.044438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 37/73] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:30 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:31.231047 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:31.231721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:31.238635 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.239481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.240324 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.241052 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.241814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.242589 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.292639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:31.294314 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:31.302593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.303570 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.304811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.308231 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.316287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.321445 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.449571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:31.464894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:31.466712 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:31.468121 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-395d2bd6-a6cb-4ed4-a8f0-afc57603ebf5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.180329 Sep 01 16:33:31.469235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:31 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:31.489708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:31.498953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f9211c46-aeec-4862-a319-0ada226200e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.272722 Sep 01 16:33:31.502328 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 37/75] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:31 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:31.532924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:31.534182 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:31.541882 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.542755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.543270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.544261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.544722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.545145 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.726305 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:31.738820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9aba29f8-e300-4093-9c5a-5da2bebeaacb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.214216 Sep 01 16:33:31.751664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 39/76] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:31 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:31.784444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:31.785120 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:31.791502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.791990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.792418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.793118 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.793567 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.793995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.861070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:31.869856 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-457e1869-e557-45f8-8f69-de54a2ff50dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.089287 Sep 01 16:33:31.870441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 38/77] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:31 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:32.068327 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:32.068933 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:32.075028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.075544 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.076097 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.076831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.077271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.077681 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.143648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:32.152270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-315dd594-59fc-4bb1-99fb-fb8de28e72da tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.088218 Sep 01 16:33:32.152840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 40/78] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:32 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:32.498627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:32.499274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:32.506076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.506563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.506995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.507702 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.508150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.509036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.526495 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:32.527091 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:32.533924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.534336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.534764 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.535604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.535922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.536879 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.589188 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:32.598341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:32.601416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:32.602693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be030a78-96e1-4db5-85a6-d66c92fd56af tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.108024 Sep 01 16:33:32.603975 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 39/79] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:32 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:32.697083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:32.704977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fab75da2-32d4-4d46-8d28-6d71d25e5b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.184769 Sep 01 16:33:32.705547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 41/80] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:32 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:32.760485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:32.761165 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:32.767431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.771274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.771274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.771274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.771274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.771716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.892079 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:32.892700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:32.899901 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.900389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.900820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.901548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.902136 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.902768 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.926844 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:32.935918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6a97c136-71ca-445b-a8d7-73b4fa1467e0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.179218 Sep 01 16:33:32.936782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 40/81] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:32 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:32.992659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:33.001000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-175a94b6-e924-48ae-80ec-c0a1c0f9c6f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.112761 Sep 01 16:33:33.001643 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 42/82] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:32 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:33.173993 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:33.174643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:33.186617 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.187290 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.187785 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:33.188741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.189186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.189602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:33.262112 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:33.270106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-23bdf446-3872-4028-9218-535b150372fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.100351 Sep 01 16:33:33.271478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 41/83] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:33 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:33.632601 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:33.633294 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:33.643777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.644504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.645112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:33.646488 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.647076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.647679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:33.726889 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:33.729337 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:33.731117 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:33.734831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:33.736490 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.737130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.737587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:33.738287 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.738744 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.739248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:33.743553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:33.745774 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:33.747890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1c21b850-3e0e-45b5-a155-a5cecda70a09 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.123782 Sep 01 16:33:33.765541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 43/84] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:33 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:33.772950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:33.902975 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:33.912533 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3cf8bfaa-a191-4540-832a-5e8225ea72c1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.190281 Sep 01 16:33:33.913124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 42/85] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:33 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:33.958095 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:33.959298 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:33.965614 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.967540 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.969878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:33.971679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.972802 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.973723 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.025278 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:34.028485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:34.035596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.036585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.037010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.037723 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.038498 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.038579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.159269 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:34.169215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e409b731-5e30-452c-98fd-b32673a29e89 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.150152 Sep 01 16:33:34.189068 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 43/86] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:34 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:34.275637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:34.283677 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6b192399-db7c-480a-8759-2807fb431e73 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.330432 Sep 01 16:33:34.284262 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 44/87] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:33 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:34.296186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:34.296815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:34.304128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.304620 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.305083 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.305821 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.306286 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.306744 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.614772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:34.621996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9f36258e-854b-4427-98cb-2be636e3e81b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.333417 Sep 01 16:33:34.622655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 44/88] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:34 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:34.780864 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:34.785555 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:34.794521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.794999 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.795745 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.799881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.800615 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.801048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.875415 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:34.888226 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:34.890413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:34.893133 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a18d7721-c0ed-43d3-8eb4-85f48345de70 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.114874 Sep 01 16:33:34.893133 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 45/89] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:34 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:34.939348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:34.940890 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:34.956335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.957557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.958442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.965000 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.965793 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.967193 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.152981 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:35.168263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb27448f-eb1f-4ec3-87e9-a596d7e7f55f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.230348 Sep 01 16:33:35.168263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 45/90] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:34 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:35.212319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:35.213102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:35.228337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.228337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.228337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.228337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.229112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.229248 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.310157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:35.310297 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:35.310891 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:35.318174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.318732 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.319250 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.319470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ef316011-830a-45fd-8b4d-ef6a608ba335 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.111446 Sep 01 16:33:35.320234 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.320429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 46/91] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:35 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:35.320770 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.321189 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.460278 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:35.468839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d5b9acb5-cdc2-4602-a2bf-67ffd4c8abb0 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.161909 Sep 01 16:33:35.468839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 46/92] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:35 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:35.643656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:35.644289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:35.651306 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.651889 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.652270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.652976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.653518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.653936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.726922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:35.735019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5dd0f3ba-6be3-4e22-9782-e62cc018da60 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.095157 Sep 01 16:33:35.735948 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 47/93] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:35 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:35.921465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:35.923784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:35.943775 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.944712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.945167 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.946586 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.947247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.948864 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.032402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:36.041784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:36.043934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:36.045352 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cef79d68-91ea-42ae-89ed-7529041a2d83 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.131243 Sep 01 16:33:36.059655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 47/94] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:35 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:36.183591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:36.185372 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:36.197035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.197623 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.203635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.203635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.203635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.203635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.346095 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:36.350198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:36.369241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:36.369607 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.369607 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.369607 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.371622 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.372142 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.372579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.384236 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2a541837-70f0-4142-bf9c-2afd400baebf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.206271 Sep 01 16:33:36.385348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 48/95] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:36 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:36.441603 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:36.450470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-79c49be1-2b63-4cfa-8faf-f40c57a8be88 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.112339 Sep 01 16:33:36.451046 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 48/96] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:36 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:36.490562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:36.491184 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:36.498421 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.499035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.499834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.500789 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.501378 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.502099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.668542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:36.679130 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1158baee-5f50-425f-8970-a5763a14371d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.193145 Sep 01 16:33:36.679742 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 49/97] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:36 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:36.757400 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:36.758010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:36.764132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.764612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.765036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.765724 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.766175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.766682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.838079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:36.846152 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b49c3c2c-67f4-4842-86b1-6c9e8b88e9d5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.093232 Sep 01 16:33:36.846719 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 49/98] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:36 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:37.070970 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:37.071595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:37.077847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.078316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.078735 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.079440 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.079880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.080287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.150474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:37.159283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:37.160975 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:37.162917 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bb0fbc13-5e99-4e30-8ee8-b36ec13a8079 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1333 microversion: 2.20 time: 0.097479 Sep 01 16:33:37.163514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 50/99] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:37 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:37.421628 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:37.422583 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:37.434493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.435198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.436008 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.437349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.438419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.439376 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.473184 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:37.474906 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:37.482862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.483661 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.484678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.485413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.485871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.486464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.596157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:37.611764 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d32cf3e9-346f-4214-bc76-2e972ef808ad tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.143108 Sep 01 16:33:37.613200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 51/100] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:37 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:37.641242 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:37.652579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb308364-26c4-426a-9918-cc3350ed8a70 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.236663 Sep 01 16:33:37.653211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 50/101] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:37 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:37.703568 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:37.704650 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:37.712754 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.713485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.714203 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.715729 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.716229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.716656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.870546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:37.870651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:37.871135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:37.876590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cf3645a5-09d4-4126-b224-6e93153c5e17 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.179195 Sep 01 16:33:37.877558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 52/102] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:37 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:37.877854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.878489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.879107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.880413 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.880946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.881356 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.949805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:37.959244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0d9f1d55-19e6-404e-b0ab-83bab2772fe9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.091844 Sep 01 16:33:37.959244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 51/103] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:37 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:38.186287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:38.187040 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:38.193975 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.194451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.194868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:38.195575 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.196013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.196926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:38.266443 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:38.277126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:38.278550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:38.279703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-448a6c77-19f0-466c-beca-d94fb79d3626 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1341 microversion: 2.20 time: 0.097532 Sep 01 16:33:38.280258 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 53/104] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:38 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:38.654988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:38.654988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:38.663410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.663894 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.664351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:38.665052 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.665547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.665964 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:38.678086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:38.678863 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:38.693258 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.693514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.693808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:38.697822 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.700362 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.701126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:38.836191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:38.846111 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e40bbae2-c214-4271-9154-99c147e89ddc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1312 microversion: 2.1 time: 0.212177 Sep 01 16:33:38.846715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 52/105] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:38 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:38.900253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:38.901974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:38.918290 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.921924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.921924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:38.921924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.922277 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.922747 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:39.043366 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:39.052122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9f4fb5e1-5cf5-4046-9cae-7dc091c1442f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.379442 Sep 01 16:33:39.053324 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 54/106] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:38 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:39.060473 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:39.061328 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:39.071663 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:39.076912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:39.076912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:39.076912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:39.076912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:39.077378 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:39.297679 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:39.302809 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:39.316476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-90eb27f1-2b84-43d0-b4a5-827024d63728 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.419802 Sep 01 16:33:39.319111 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 53/107] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:38 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:39.329706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:39.331450 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:39.334726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-09c4c5f1-0068-4f3c-8bd8-de9b56f381a0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1290 microversion: 2.1 time: 0.279881 Sep 01 16:33:39.335511 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 55/108] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:39 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1290 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:39.348358 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:39.349621 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:39.350641 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:39.351948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:39.352754 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:39.353547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:39.521931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:39.532388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:39.534211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:39.535475 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-113ca536-2188-45b7-b250-e14742a0b3d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1351 microversion: 2.20 time: 0.214871 Sep 01 16:33:39.536875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 54/109] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:39 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1351 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:39.870310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:39.872169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:39.879931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:39.881061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:39.881660 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:39.883032 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:39.883133 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:39.884372 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.083568 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:40.083568 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:40.101834 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.105358 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.106179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.108403 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.109051 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.109709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.168738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:40.178673 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0c32fabb-da4e-452b-9438-6ce1534ada13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1300 microversion: 2.1 time: 0.312426 Sep 01 16:33:40.183295 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 56/110] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:39 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1300 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:40.342217 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:40.342818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:40.361602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.362332 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.363733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.367598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.369553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.370634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.727438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:40.749351 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-98122e34-1dbf-4243-a7f5-a05dbf4dfbfb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.410952 Sep 01 16:33:40.751644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 57/111] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:40 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:40.757377 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:40.758256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:40.784550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.784550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.784963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.785661 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.786310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.789835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.889645 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:40.903472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b9219922-d905-4b1b-9057-a1a933d38211 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.828408 Sep 01 16:33:40.913637 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 55/112] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:40 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:40.940919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:40.941422 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:40.977929 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.978387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.979309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.983436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.984013 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.984449 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.991564 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:41.005698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3e19b31f-941c-404a-9302-ec1110c9bafa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1296 microversion: 2.1 time: 0.246403 Sep 01 16:33:41.006217 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 58/113] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:40 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1296 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:41.133765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:41.156010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:41.156010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:41.157460 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-57a35154-dce4-4296-8fe3-9f8cc0d3d04f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1339 microversion: 2.20 time: 0.241365 Sep 01 16:33:41.167961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 56/114] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:40 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1339 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:41.202843 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:41.207552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:41.216774 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:41.218947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:41.219867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:41.221115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:41.222388 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:41.223064 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:41.239473 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:41.616218 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-352a0443-3657-4667-8f7c-098c98722a48 req-e89bca6e-f238-43be-9761-e2cf8bc46fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef204bf-186e-4c11-81b9-e7a1470f9be6", "tag": "6a4a674f-828e-4f19-a547-ea249ae3ee42"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:41.664273 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-352a0443-3657-4667-8f7c-098c98722a48 req-e89bca6e-f238-43be-9761-e2cf8bc46fb2 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:41.666197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-352a0443-3657-4667-8f7c-098c98722a48 req-e89bca6e-f238-43be-9761-e2cf8bc46fb2 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:41.668309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-352a0443-3657-4667-8f7c-098c98722a48 req-e89bca6e-f238-43be-9761-e2cf8bc46fb2 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:41.743075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-352a0443-3657-4667-8f7c-098c98722a48 req-e89bca6e-f238-43be-9761-e2cf8bc46fb2 service nova] Creating event network-changed:6a4a674f-828e-4f19-a547-ea249ae3ee42 for instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 on hv-cinder-83602 Sep 01 16:33:41.747782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-352a0443-3657-4667-8f7c-098c98722a48 req-e89bca6e-f238-43be-9761-e2cf8bc46fb2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 16:33:41.747782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-352a0443-3657-4667-8f7c-098c98722a48 req-e89bca6e-f238-43be-9761-e2cf8bc46fb2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 16:33:41.747782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-733ad0d6-23c6-4a80-8eb2-7b0212f38942 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:41.747782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-733ad0d6-23c6-4a80-8eb2-7b0212f38942 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:41.747782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-733ad0d6-23c6-4a80-8eb2-7b0212f38942 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:41.758214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-733ad0d6-23c6-4a80-8eb2-7b0212f38942 None None] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:41.758698 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-733ad0d6-23c6-4a80-8eb2-7b0212f38942 None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:41.759128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-733ad0d6-23c6-4a80-8eb2-7b0212f38942 None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:41.806797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.compute.rpcapi [None req-733ad0d6-23c6-4a80-8eb2-7b0212f38942 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 16:33:41.813030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-733ad0d6-23c6-4a80-8eb2-7b0212f38942 None None] Releasing lock "compute-rpcapi-router" {{(pid=127531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 16:33:41.848920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-733ad0d6-23c6-4a80-8eb2-7b0212f38942 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331323 Sep 01 16:33:41.850317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 57/115] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:33:41.863920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:41.867113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:41.890414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:41.892423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:41.900612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:41.900612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:41.900612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:41.900612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.040749 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:42.112444 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-14c7d4c8-b43c-410c-8475-28b4a2de383e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.885520 Sep 01 16:33:42.112444 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 59/116] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:41 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:42.184632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-f7dff3ab-3f56-4c93-8342-b37c91df729c req-2ecddff6-ed5d-4078-b702-255be005335b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4209cd9-68c3-4e8a-9c4c-d560a8d74045", "tag": "6cb7a377-8b7d-4061-a223-f3f3c40c8fae"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:42.198656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f7dff3ab-3f56-4c93-8342-b37c91df729c req-2ecddff6-ed5d-4078-b702-255be005335b service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.199625 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f7dff3ab-3f56-4c93-8342-b37c91df729c req-2ecddff6-ed5d-4078-b702-255be005335b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.199997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f7dff3ab-3f56-4c93-8342-b37c91df729c req-2ecddff6-ed5d-4078-b702-255be005335b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.221818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-f7dff3ab-3f56-4c93-8342-b37c91df729c req-2ecddff6-ed5d-4078-b702-255be005335b service nova] Creating event network-changed:6cb7a377-8b7d-4061-a223-f3f3c40c8fae for instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 on hv-cinder-83602 Sep 01 16:33:42.222443 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f7dff3ab-3f56-4c93-8342-b37c91df729c req-2ecddff6-ed5d-4078-b702-255be005335b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127532) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 16:33:42.222891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f7dff3ab-3f56-4c93-8342-b37c91df729c req-2ecddff6-ed5d-4078-b702-255be005335b service nova] Acquired lock "compute-rpcapi-router" {{(pid=127532) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 16:33:42.224816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f9a07b2f-34ac-48a7-a74b-71470a80f914 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.225504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f9a07b2f-34ac-48a7-a74b-71470a80f914 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.226009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f9a07b2f-34ac-48a7-a74b-71470a80f914 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.226816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f9a07b2f-34ac-48a7-a74b-71470a80f914 None None] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.227563 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f9a07b2f-34ac-48a7-a74b-71470a80f914 None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.228049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f9a07b2f-34ac-48a7-a74b-71470a80f914 None None] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.234974 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:42.238756 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.compute.rpcapi [None req-f9a07b2f-34ac-48a7-a74b-71470a80f914 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 16:33:42.240433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f9a07b2f-34ac-48a7-a74b-71470a80f914 None None] Releasing lock "compute-rpcapi-router" {{(pid=127532) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 16:33:42.260705 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f9a07b2f-34ac-48a7-a74b-71470a80f914 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163702 Sep 01 16:33:42.269987 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 60/117] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:42.269987 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:42.269987 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:42.276512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.277084 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.277578 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.278338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.278928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.279635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.387688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:42.397900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-367e8c14-0fcb-42ef-9295-3135e8c5111a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.546045 Sep 01 16:33:42.399385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 58/118] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:41 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:42.405043 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:42.406197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:42.414394 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.415091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.415609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.416881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.417553 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.418030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.440340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:42.585156 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:42.596809 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-443a943b-240f-4625-b73c-04f301aed376 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1296 microversion: 2.1 time: 0.195932 Sep 01 16:33:42.620786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 59/119] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:42 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1296 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:42.624051 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:42.626827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:42.643485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.644627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.648032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.649729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.650874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.651632 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.759190 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:42.766675 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-53b1b277-2c1e-4d3b-896c-e502cca78f9d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.502882 Sep 01 16:33:42.771103 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 61/120] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:42 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:43.107755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:43.108482 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:43.126755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:43.127272 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:43.127702 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:43.128481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:43.129148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:43.130312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:43.162071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:43.175265 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:43.177033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:43.185516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-31fdb160-f124-4cbb-81a1-52103129f972 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.558527 Sep 01 16:33:43.186594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 60/121] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:42 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:43.339992 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:43.349171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-03201a73-c843-408f-b0b3-5a74ffd06a6f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.244673 Sep 01 16:33:43.373560 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 62/122] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:43 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:43.420048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:43.420732 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:43.429093 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:43.433031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:43.433031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:43.433031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:43.433031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:43.433562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:43.626552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:43.627305 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:43.654936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:43.654936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:43.654936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:43.654936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:43.655446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:43.655446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:43.710380 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:43.718800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f259445a-349b-4862-89f1-b4b0640c2920 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.302807 Sep 01 16:33:43.723238 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 61/123] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:43 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:43.791194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:43.792132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:43.798309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:43.798934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:43.799507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:43.800478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:43.800989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:43.801677 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:43.828309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:43.838752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2ab98a5e-5b75-4067-8448-3f87d30c1135 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.216565 Sep 01 16:33:43.840095 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 63/124] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:43 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:43.885734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-768f2b68-f522-4e5e-b8a2-3d4560431559 req-33449a40-3a38-4e81-b8be-47d45a8a742d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f", "tag": "7528df97-c3e6-4a5e-8a1c-e62df28e6f83"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:43.895825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-768f2b68-f522-4e5e-b8a2-3d4560431559 req-33449a40-3a38-4e81-b8be-47d45a8a742d service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:43.896500 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-768f2b68-f522-4e5e-b8a2-3d4560431559 req-33449a40-3a38-4e81-b8be-47d45a8a742d service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:43.897072 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-768f2b68-f522-4e5e-b8a2-3d4560431559 req-33449a40-3a38-4e81-b8be-47d45a8a742d service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:43.908418 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-768f2b68-f522-4e5e-b8a2-3d4560431559 req-33449a40-3a38-4e81-b8be-47d45a8a742d service nova] Creating event network-changed:7528df97-c3e6-4a5e-8a1c-e62df28e6f83 for instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f on hv-cinder-83602 Sep 01 16:33:43.914813 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-768f2b68-f522-4e5e-b8a2-3d4560431559 req-33449a40-3a38-4e81-b8be-47d45a8a742d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032736 Sep 01 16:33:43.915686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 64/125] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:43.992894 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:44.000683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1d73e540-3d24-4a87-aea5-12b6f0db4024 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.213656 Sep 01 16:33:44.001346 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 62/126] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:43 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:44.212308 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:44.213099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:44.219932 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:44.220425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:44.220881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:44.221569 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:44.222014 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:44.222468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:44.305765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-7c445882-627f-4d9e-bb24-2b1aa6a8d6d4 req-f1a945c4-3333-4d7b-b725-60f088bcf1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9ab9d9-bf46-47be-a669-b7262afa36c5", "tag": "72a909ce-ea6e-4de0-9ca1-03139d0f535e"}, {"name": "network-changed", "server_uuid": "dfd400b6-5c1a-4460-9cc0-275782d91b4a", "tag": "ac74679f-5302-4fd4-945b-001fa0f572f7"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:44.316651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7c445882-627f-4d9e-bb24-2b1aa6a8d6d4 req-f1a945c4-3333-4d7b-b725-60f088bcf1ac service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:44.317112 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7c445882-627f-4d9e-bb24-2b1aa6a8d6d4 req-f1a945c4-3333-4d7b-b725-60f088bcf1ac service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:44.318830 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7c445882-627f-4d9e-bb24-2b1aa6a8d6d4 req-f1a945c4-3333-4d7b-b725-60f088bcf1ac service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:44.332002 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-7c445882-627f-4d9e-bb24-2b1aa6a8d6d4 req-f1a945c4-3333-4d7b-b725-60f088bcf1ac service nova] Creating event network-changed:72a909ce-ea6e-4de0-9ca1-03139d0f535e for instance 4f9ab9d9-bf46-47be-a669-b7262afa36c5 on hv-cinder-83602 Sep 01 16:33:44.332488 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-7c445882-627f-4d9e-bb24-2b1aa6a8d6d4 req-f1a945c4-3333-4d7b-b725-60f088bcf1ac service nova] Creating event network-changed:ac74679f-5302-4fd4-945b-001fa0f572f7 for instance dfd400b6-5c1a-4460-9cc0-275782d91b4a on hv-cinder-83602 Sep 01 16:33:44.340123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-7c445882-627f-4d9e-bb24-2b1aa6a8d6d4 req-f1a945c4-3333-4d7b-b725-60f088bcf1ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038200 Sep 01 16:33:44.340889 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 63/127] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:33:44.371601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:44.373906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:44.379587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:44.380633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:44.380985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:44.381770 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:44.382152 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:44.383196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:44.401986 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:44.410017 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:44.418550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:44.418550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e3c80c0d-5d26-42ec-b42e-2ec08301ba9f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.206578 Sep 01 16:33:44.418550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 65/128] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:44 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:44.515442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:44.523984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dc518322-598b-4eda-864b-38c30a94b90b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.157105 Sep 01 16:33:44.524675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 64/129] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:44 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:44.740958 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:44.741647 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:44.747417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:44.747894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:44.748319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:44.748989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:44.749429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:44.749838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:44.867431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:44.867431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:44.868434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:44.869239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:44.869661 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:44.870556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:44.871066 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:44.871708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:44.894371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:44.904582 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-078c915b-2cb4-401f-9fce-266231aa4d1c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.167828 Sep 01 16:33:44.905375 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 66/130] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:44 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:45.007384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:45.014967 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-473da04a-a7a8-4d46-a820-8ddce00239de tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.158480 Sep 01 16:33:45.015601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 65/131] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:44 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:45.021976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:45.022578 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:45.028670 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:45.029263 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:45.029694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:45.030384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:45.031211 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:45.031342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:45.163636 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:45.171115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-35d2030c-ce9e-4081-903c-9dd6f67c0491 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.153267 Sep 01 16:33:45.171710 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 67/132] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:45 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:45.435712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:45.436316 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:45.443553 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:45.444052 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:45.444502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:45.445198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:45.445643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:45.446055 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:45.545375 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:45.546061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:45.553313 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:45.553791 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:45.554228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:45.554898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:45.555367 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:45.555776 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:45.606499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:45.616216 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:45.617807 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:45.618918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb76bb05-fca4-416c-bd9b-f352d56f64ad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.187128 Sep 01 16:33:45.619503 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 66/133] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:45 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:45.694009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:45.707464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3097a9cf-ebb2-4906-bb4f-18a54426e8ae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.160977 Sep 01 16:33:45.707464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 68/134] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:45 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:45.924582 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:45.925106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:45.931415 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:45.931899 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:45.932324 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:45.933010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:45.933447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:45.933861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:46.036266 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:46.036912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:46.043859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:46.044584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:46.045118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:46.046147 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:46.046781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:46.047596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:46.076188 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:46.092561 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb5312c4-aa42-4831-b895-05f54f45fc6e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.171791 Sep 01 16:33:46.093150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:45 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:46.191075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:46.192374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:46.192980 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:46.199434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:46.200108 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:46.200543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:46.201142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-36ffd034-94a7-466d-b583-989f9663218c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.168163 Sep 01 16:33:46.201263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:46.201923 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:46.202049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:46 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:46.202147 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:46.338113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:46.346226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7da65cd4-a877-4936-8a95-5f73ff34cd8c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.157901 Sep 01 16:33:46.346829 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 68/137] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:46 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:46.641956 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:46.642677 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:46.649995 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:46.650481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:46.650909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:46.651700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:46.652131 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:46.652543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:46.726125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:46.726125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:46.731076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:46.731659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:46.732160 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:46.732952 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:46.733509 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:46.735141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:46.793000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:46.801381 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:46.803840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:46.804949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6f694c1b-8e3d-4d39-aae5-e150ae5190b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.166955 Sep 01 16:33:46.805508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 70/138] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:46 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:46.871946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:46.879794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d5c280e2-4496-421f-b277-e44bf0778834 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.160588 Sep 01 16:33:46.880416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 69/139] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:46 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:47.113838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:47.114509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:47.121015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.127090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.127090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.127090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.127090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.127848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.223110 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:47.224520 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:47.227863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:47.231902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.232489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.233011 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.233793 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.234338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.234845 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.276124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:47.282237 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f89c00a4-86ba-495e-912d-eb4a617eca79 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.172496 Sep 01 16:33:47.283044 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 71/140] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:47 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:47.367684 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:47.368291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:47.374188 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.374659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.374965 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:47.375096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.375766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.376202 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.376610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.383683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b78e4365-34d8-43a0-8a6d-0b9f86a21848 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.164754 Sep 01 16:33:47.384387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 70/141] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:47 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:47.521101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:47.528993 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ddcac941-446c-44bc-a93d-d033c88d58b0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.165549 Sep 01 16:33:47.529557 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 72/142] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:47 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:47.827426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:47.828101 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:47.840910 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.841392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.841813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.842498 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.842941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.843478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.901316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:47.902576 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:47.909346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.909823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.910242 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.910929 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:47.911558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:47.912170 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:47.987397 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:47.996786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:47.998279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:47.999512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8f4d610e-7011-450a-a76c-73509d3344b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.176027 Sep 01 16:33:48.000163 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 71/143] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:47 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:48.078403 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:48.087923 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b1ee890c-acd0-49cd-a5aa-65b0850bc8bc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.190846 Sep 01 16:33:48.088506 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 73/144] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:47 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:48.306278 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:48.307004 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:48.314137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:48.314634 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:48.315135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:48.315972 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:48.316425 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:48.316852 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:48.405395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:48.406223 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:48.412430 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:48.412922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:48.413438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:48.414075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:48.414520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:48.414936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:48.480559 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:48.489571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e2328186-c7b5-4619-8452-34cb7e55112e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.188745 Sep 01 16:33:48.490577 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 72/145] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:48 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:48.551311 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:48.553138 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:48.559426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:48.559905 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:48.560336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:48.561019 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:48.561455 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:48.561885 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:48.566521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:48.576250 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7c83e900-a56f-454c-9342-05bb6597e03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.174733 Sep 01 16:33:48.576942 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 74/146] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:48 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:48.702594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:48.710717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-04e0fb23-1995-472a-8b4a-cec7142abb41 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.163361 Sep 01 16:33:48.711375 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 73/147] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:48 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:49.024068 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:49.024671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:49.030839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.034848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.034848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.035884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.036061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.036990 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.108863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:49.109747 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:49.116702 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.117313 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.117744 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.118483 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.118927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.119367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.185111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:49.196086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:49.197654 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:49.198782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-70c3b8e4-23c6-40ae-bb88-68b32ce0277f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.179831 Sep 01 16:33:49.199362 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 75/148] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:49 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:49.293978 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:49.309605 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-01c3ca23-2ad5-4133-b275-159d5fd0bec3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.204579 Sep 01 16:33:49.310667 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 74/149] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:49 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:49.512410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:49.512410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:49.517755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.520299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.520299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.520299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.520299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.521277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.600718 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:49.601414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:49.620318 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.620318 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.620318 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.620318 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.622963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.623514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.686995 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:49.697101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2d6a2345-d374-4311-8b3f-95546418088f tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.190092 Sep 01 16:33:49.697713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:49 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:49.733241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:49.733927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:49.741199 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.741793 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.742295 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.743070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:49.743708 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:49.744683 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:49.772866 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:49.781596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d9485f9b-cb38-4003-a1ac-9c524debf10d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.188079 Sep 01 16:33:49.782308 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:49 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:49.887988 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:49.897317 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-48befe25-aa45-4651-9172-61e4de1dbef4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.168691 Sep 01 16:33:49.904919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 77/152] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:49 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:50.228377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:50.229417 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:50.240335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:50.241436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:50.242247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:50.243624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:50.244514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:50.245355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:50.338565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:50.340464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:50.350634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:50.351619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:50.352538 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:50.353894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:50.354842 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:50.356025 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:50.400153 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:50.919202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:50.924992 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:50.925978 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:50.935896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:50.936228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5505f1db-457e-4909-8b82-80e39a99d266 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.606205 Sep 01 16:33:50.939466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:50.942106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-94feb490-50bb-4e7a-ac7f-8b34fbde1829 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.721171 Sep 01 16:33:50.944692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 76/153] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:50 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:50.952206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 78/154] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:50 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:50.965739 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:50.966168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:50.966750 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:50.967881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:50.974438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:50.975443 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:50.976261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:50.977308 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:50.977996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:50.978676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:50.985873 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:50.986386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:50.994932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:50.994932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:50.994932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:50.994932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:51.192751 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:51.201909 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7cb1294d-412c-44ab-80a1-10695667920d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.255898 Sep 01 16:33:51.202502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 77/155] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:50 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:51.209910 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:51.209910 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:51.218249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:51.222429 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:51.222919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:51.223377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:51.224090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:51.224532 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:51.225034 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-09ca7252-6cf2-47fa-b333-6a587540e9fd tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.271570 Sep 01 16:33:51.225202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:51.226026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 79/156] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:50 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:51.461581 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:51.470047 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f6615306-f61b-4834-b26e-637fdedd5c1c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.266511 Sep 01 16:33:51.470626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 78/157] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:51 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:51.683503 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-456e12e1-3a0f-4655-99fd-34964aa1db77 req-034e0d24-394c-4bd7-b5b7-090d6f20d6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9c562a4-a89a-4fb1-9f85-e9efa1183ff1", "tag": "ccc88b9b-88ad-4e4f-9efa-bcefeca59f9e"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:51.691501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-456e12e1-3a0f-4655-99fd-34964aa1db77 req-034e0d24-394c-4bd7-b5b7-090d6f20d6e3 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:51.691976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-456e12e1-3a0f-4655-99fd-34964aa1db77 req-034e0d24-394c-4bd7-b5b7-090d6f20d6e3 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:51.693112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-456e12e1-3a0f-4655-99fd-34964aa1db77 req-034e0d24-394c-4bd7-b5b7-090d6f20d6e3 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:51.714591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-456e12e1-3a0f-4655-99fd-34964aa1db77 req-034e0d24-394c-4bd7-b5b7-090d6f20d6e3 service nova] Creating event network-changed:ccc88b9b-88ad-4e4f-9efa-bcefeca59f9e for instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 on hv-cinder-83602 Sep 01 16:33:51.721364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-456e12e1-3a0f-4655-99fd-34964aa1db77 req-034e0d24-394c-4bd7-b5b7-090d6f20d6e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048577 Sep 01 16:33:51.730148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 80/158] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:51.959308 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:51.960029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:51.962025 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:51.968775 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:51.969356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:51.969615 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:51.970038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:51.970398 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:51.971131 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:51.971779 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:51.972414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:51.979143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:51.979667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:51.980101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:51.980802 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:51.981450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:51.982033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:52.131907 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:52.132960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-521ab435-2901-4e8e-95ca-9f797d07b896 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.178089 Sep 01 16:33:52.133660 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 79/159] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:51 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:52.137571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:52.146950 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:52.148475 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:52.149584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-47c1727e-2154-4557-9c75-704739274724 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.184675 Sep 01 16:33:52.150138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 81/160] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:51 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:33:52.225987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:52.226597 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:52.232552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:52.233034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:52.233470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:52.234150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:52.234631 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:52.235045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:52.246844 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:52.249758 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:52.255066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:52.257096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:52.263119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:52.263119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:52.263119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:52.263119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:52.263471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:52.385987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:52.394181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-78051077-fa58-4a5e-80c4-dfe5aeb36c6d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.172797 Sep 01 16:33:52.394768 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 80/161] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:52 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:52.399641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:52.407582 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-252d084b-e29f-4e8d-83d3-9fceb03b3611 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.165370 Sep 01 16:33:52.408155 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 82/162] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:52 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:52.492857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:52.493495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:52.500333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:52.504006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:52.504006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:52.504006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:52.504006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:52.504499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:52.651480 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:52.660330 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-427cd0df-ea89-4cb2-872e-0397c5e1706b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.171354 Sep 01 16:33:52.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 81/163] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:52 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:53.157375 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:53.157375 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:53.162816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.163331 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.163812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:53.164512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.164947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.165358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:53.179176 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:53.181799 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:53.186232 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.186715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.187139 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:53.187986 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.188422 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.189103 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:53.321791 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:53.332498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b46549b5-ec3e-4f9f-9587-86f8adeb2b35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.181826 Sep 01 16:33:53.334174 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 83/164] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:53 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:53.351402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:53.360101 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:53.361529 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:53.362819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-753c73ef-92d1-4883-bfb2-5f15adee7739 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.188825 Sep 01 16:33:53.363857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 82/165] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:53 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:33:53.426336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:53.428941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:53.433169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:53.437446 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:53.450671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.452829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.453425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:53.454799 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.456227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.457205 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.458597 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.459115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:53.460442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:53.462013 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.465029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.465812 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:53.819485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:53.828760 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8d3634ba-8d57-4143-93fd-9ea3d02aa5ac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.401283 Sep 01 16:33:53.829690 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 83/166] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:53 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:53.835798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:53.836461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:53.843085 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.843689 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.846599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:53.846599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:53.846599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:53.846599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:54.315616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:54.326595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-436c59b3-166f-4bb4-b9a7-f3b556306586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.495153 Sep 01 16:33:54.340296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 84/167] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:53 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:54.357804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:54.358700 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:54.376425 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:54.377982 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:54.378385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:54.379103 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:54.379588 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:54.380242 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:54.387290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:54.401345 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-57726f89-0056-4725-b0cb-2582149d33fb tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.984231 Sep 01 16:33:54.411982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 84/168] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:53 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:54.425598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:54.426375 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:54.433397 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:54.434880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:54.435669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:54.436655 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:54.437300 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:54.437921 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:54.861026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:54.876009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:54.882352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:54.884666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b9478b52-9d29-4267-8513-52092e4ddcaf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.463745 Sep 01 16:33:54.886399 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 85/169] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:54 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:54.933285 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:54.946507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4382d4e6-fbfc-47ac-bd74-c78cf7cf0625 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.593560 Sep 01 16:33:54.948163 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 85/170] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:54 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:54.953708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:54.954402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:54.962980 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:54.964294 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:54.964733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:54.965453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:54.965906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:54.966327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:55.140098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:55.140098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-16148050-5c6a-484c-89c8-768051733717 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.184118 Sep 01 16:33:55.140098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 86/171] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:54 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:55.152667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-04b0b8ac-3da5-4eb1-9432-2d97d1ce9565 req-682f76a3-9441-411f-820e-ff744d6e2371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef204bf-186e-4c11-81b9-e7a1470f9be6", "name": "network-vif-plugged", "status": "completed", "tag": "6a4a674f-828e-4f19-a547-ea249ae3ee42"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:55.167198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-04b0b8ac-3da5-4eb1-9432-2d97d1ce9565 req-682f76a3-9441-411f-820e-ff744d6e2371 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:55.169213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-04b0b8ac-3da5-4eb1-9432-2d97d1ce9565 req-682f76a3-9441-411f-820e-ff744d6e2371 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:55.169428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-04b0b8ac-3da5-4eb1-9432-2d97d1ce9565 req-682f76a3-9441-411f-820e-ff744d6e2371 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:55.189152 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-04b0b8ac-3da5-4eb1-9432-2d97d1ce9565 req-682f76a3-9441-411f-820e-ff744d6e2371 service nova] Creating event network-vif-plugged:6a4a674f-828e-4f19-a547-ea249ae3ee42 for instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 on hv-cinder-83602 Sep 01 16:33:55.203798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-04b0b8ac-3da5-4eb1-9432-2d97d1ce9565 req-682f76a3-9441-411f-820e-ff744d6e2371 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308818 Sep 01 16:33:55.203798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 86/172] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:55.346405 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:55.347412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:55.354204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:55.356306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:55.356306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:55.356306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:55.356601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:55.356870 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:55.428104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:55.429110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:55.435824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:55.436297 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:55.436718 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:55.437396 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:55.437842 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:55.438362 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:55.510151 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:55.518465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c2349143-ef93-48ae-97e9-91c64c6eac30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.176364 Sep 01 16:33:55.519041 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 87/173] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:55 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:55.625648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:55.634112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-567411ec-b9f1-461a-abae-15766fae2d6c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.210333 Sep 01 16:33:55.634689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 87/174] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:55 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:55.913878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:55.914729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:55.920744 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:55.921223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:55.921670 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:55.922313 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:55.922751 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:55.923183 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:55.971333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:55.971644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:55.980342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:55.981039 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:55.981611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:55.982470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:55.982915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:55.983411 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:56.082613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:56.096054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:56.101151 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:56.102314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e327ca1d-6049-4a84-bc8c-3d180ebc68aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.193139 Sep 01 16:33:56.117093 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 88/175] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:55 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:56.144721 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:56.153921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:56.154533 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:56.165800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f8e40152-04aa-4947-b90a-d02861b3b831 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.200057 Sep 01 16:33:56.166396 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 88/176] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:55 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:56.179529 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:56.180133 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:56.180681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:56.181419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:56.181872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:56.182493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:56.332089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:56.342946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d9179a2e-4f25-4628-85b1-4856d15ecc68 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.192907 Sep 01 16:33:56.343565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 89/177] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:56 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:56.540815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:56.547612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:56.548961 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:56.549445 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:56.549867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:56.550632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:56.551071 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:56.552281 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:56.663523 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:56.668933 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:56.672940 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:56.673904 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:56.674526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:56.676058 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:56.676992 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:56.677881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:56.774134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:56.781496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ae57f6d7-99bc-434f-8175-181a0b307583 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.245095 Sep 01 16:33:56.782760 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 89/178] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:56 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:56.854237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:56.864372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-26d30327-a26f-4d20-bf5e-b9122c8e5002 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.206178 Sep 01 16:33:56.865340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 90/179] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:56 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:57.130387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.131242 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:57.139387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.140247 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.141115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.141926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.142443 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.143006 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.186281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.187844 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:57.195513 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.196488 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.197206 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.198244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.198930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.199602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.360229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:57.371282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:57.373099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:57.374622 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3ccb1a17-a439-431b-91a7-c1cf9178db46 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.248819 Sep 01 16:33:57.382929 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 90/180] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:57.387985 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.388781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:57.396134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.397041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.397632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.398336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.398787 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.399249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.509882 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:57.516377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-79839e7d-abc5-492d-97e9-0d25127787dc tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.334045 Sep 01 16:33:57.517181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 91/181] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:57.580681 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:57.589452 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1ce344fd-f491-439d-9e89-df061781b0fc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.205155 Sep 01 16:33:57.590081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:57.805190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.806060 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:57.812675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.813464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.814902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.815658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.816112 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.816557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.889319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:57.889948 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:57.897159 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.898003 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.899884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.901278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:57.901985 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:57.902635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:57.987747 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:57.997767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3bdb6f16-e99b-4532-b4fa-fa3b2a2acfdc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.196894 Sep 01 16:33:57.999106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 92/183] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:58.039801 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-a739a037-f91c-4e0a-9e63-743bd5e51d18 req-75e603cf-9766-47be-96d7-47eff6d10513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4209cd9-68c3-4e8a-9c4c-d560a8d74045", "name": "network-vif-plugged", "status": "completed", "tag": "6cb7a377-8b7d-4061-a223-f3f3c40c8fae"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:58.050555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a739a037-f91c-4e0a-9e63-743bd5e51d18 req-75e603cf-9766-47be-96d7-47eff6d10513 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:58.051037 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a739a037-f91c-4e0a-9e63-743bd5e51d18 req-75e603cf-9766-47be-96d7-47eff6d10513 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:58.052357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a739a037-f91c-4e0a-9e63-743bd5e51d18 req-75e603cf-9766-47be-96d7-47eff6d10513 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:58.067074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-a739a037-f91c-4e0a-9e63-743bd5e51d18 req-75e603cf-9766-47be-96d7-47eff6d10513 service nova] Creating event network-vif-plugged:6cb7a377-8b7d-4061-a223-f3f3c40c8fae for instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 on hv-cinder-83602 Sep 01 16:33:58.072944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-a739a037-f91c-4e0a-9e63-743bd5e51d18 req-75e603cf-9766-47be-96d7-47eff6d10513 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037797 Sep 01 16:33:58.079339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 93/184] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:33:58.089456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:58.102610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9a16fd8f-158e-49c8-aa03-e81fc7737fea tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.218443 Sep 01 16:33:58.104081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 92/185] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:57 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:58.398577 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:58.399277 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:58.405609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:58.410526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:58.410526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:58.410526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:58.410526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:58.411703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:58.413005 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:58.539189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:58.540099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:58.548309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:58.549213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:58.549854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:58.556714 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:58.556714 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:58.556714 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:58.572289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:58.584860 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:58.586337 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:58.589378 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5a72bad4-f333-4272-92e6-54b0fcea9b72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.194574 Sep 01 16:33:58.591453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 94/186] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:58 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:58.610253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:58.611317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:58.619928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:58.619928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:58.619928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:58.619928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:58.620264 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:58.620264 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:58.717204 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:58.726727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c8ef77b7-20ae-4c3d-8aa8-411d32888b57 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.192378 Sep 01 16:33:58.727339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 93/187] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:58 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:58.782860 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:58.791005 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-61668af6-f129-4b95-995d-7367bc87c667 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.184411 Sep 01 16:33:58.791618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 95/188] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:58 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:59.021659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.022290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:59.028705 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.029188 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.029640 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.030388 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.030770 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.031241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.124296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.127315 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:59.135448 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.135988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.136450 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.137147 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.137600 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.138015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.180434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:59.190862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e154c578-1a11-4956-82fc-9a7716296e28 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.172176 Sep 01 16:33:59.190862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 94/189] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:59.348998 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:59.357470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a90b42a1-cafd-41ed-b2ae-c466fab0dd0a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.237122 Sep 01 16:33:59.358149 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 96/190] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:59.612077 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.612266 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:59.619513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.619998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.620565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.621243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.621682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.622157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.752559 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.753875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:59.761728 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.762507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.763131 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.764138 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.764997 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.765592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.795288 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:59.806228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:59.808266 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:59.814902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8717a0aa-dd66-44c8-a8ae-9ec490f27c43 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.203227 Sep 01 16:33:59.814902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 95/191] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:33:59.819771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:59.820376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:59.836224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.836719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.837147 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.841811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:59.843995 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:59.845858 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:59.856053 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:59.952704 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:59.962313 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f12e51e2-39f4-44fe-9997-c6f94bc190a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.212358 Sep 01 16:33:59.962929 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 97/192] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:00.034376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:00.043703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-24df071d-224f-49b0-bd89-91bb77d2e416 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.229841 Sep 01 16:34:00.044291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 96/193] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:59 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:00.213090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:00.213813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:00.220557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:00.221113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:00.221596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:00.222760 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:00.222760 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:00.226750 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:00.371366 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:00.379748 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:00.381272 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:00.382905 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bf0fec29-3a69-4267-b4a8-689e5e8918e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.175398 Sep 01 16:34:00.383658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 98/194] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:00 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:00.387832 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:00.388382 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:00.388865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:00.389612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:00.390118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:00.390606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:00.527365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:00.543303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3bf07cde-8bf4-42f5-aa19-c453bb45fa4e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.167783 Sep 01 16:34:00.543895 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 97/195] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:00 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:00.840026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:00.840710 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:00.847963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:00.848693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:00.849540 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:00.850310 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:00.850825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:00.851340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:00.986487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:00.987415 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:00.994191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:00.994870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:00.995381 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:00.996060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:00.996662 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:01.002981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:01.018678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:01.027877 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:01.029402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:01.030713 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1b51b4b8-a410-453e-9e9e-397bef89d526 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.197662 Sep 01 16:34:01.035211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 99/196] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:00 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:01.066502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:01.068034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:01.074116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:01.074603 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:01.075032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:01.075753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:01.076338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:01.076642 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:01.214902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:01.222844 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5636d115-ab64-4910-aab6-84cf5b76786d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.241079 Sep 01 16:34:01.224122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 98/197] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:00 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:01.235630 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:01.245505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3f744ceb-c459-4eed-805c-c8f838f3d852 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.183363 Sep 01 16:34:01.246178 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 100/198] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:01 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:01.404240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:01.405171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:01.411928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:01.412403 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:01.412824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:01.413514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:01.413952 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:01.414552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:01.562132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:01.565104 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:01.565768 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:01.572579 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d6e3b6d2-2180-4720-af9f-e2b4b9165a4d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.172220 Sep 01 16:34:01.573348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:01.573490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 99/199] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:01 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:01.574192 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:01.574862 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:01.575793 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:01.576266 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:01.576858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:01.715028 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:01.723466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9989ad13-0edf-4815-8f08-d7c48e43ea4d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.163167 Sep 01 16:34:01.724282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 101/200] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:01 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:02.054163 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:02.054769 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:02.060767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.061241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.061752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.062396 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.062841 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.063290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.211740 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:02.219994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:02.221426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:02.222656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-28aaf1b2-d662-4ad1-9f6d-225d64de3467 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.173039 Sep 01 16:34:02.223319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 100/201] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:02 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:02.245378 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:02.246832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:02.253080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.253567 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.253995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.255392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.256061 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.256719 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.268868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:02.269595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:02.277373 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.278028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.278530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.279322 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.280125 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.280615 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.418387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:02.431087 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a245f461-ed0b-4ba5-8636-fe74f788a23a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.189862 Sep 01 16:34:02.439199 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 102/202] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:02 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:02.439393 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:02.445962 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-319f37e6-2c57-4db8-8c4d-5cd08e25c69b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.181089 Sep 01 16:34:02.446941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 101/203] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:02 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:02.594586 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:02.595506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:02.602212 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.602692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.603112 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.603823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.604262 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.604835 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.736823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:02.744524 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:02.745161 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:02.746122 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-12aec560-7512-4f0b-a5fa-c0fc1b9c9186 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.155362 Sep 01 16:34:02.746708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 103/204] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:02 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:02.751463 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.751925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.752348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.753037 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:02.753538 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:02.753955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:02.900023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:02.907689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-add9ee64-c8ee-435b-96c9-0eb052bbad2a tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.167135 Sep 01 16:34:02.908253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 102/205] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:02 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:03.254500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:03.259606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:03.271977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:03.272465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:03.273097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:03.273806 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:03.274611 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:03.275281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:03.453998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:03.454615 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:03.476242 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:03.477076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:03.477782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:03.478950 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:03.479886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:03.480712 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:03.635438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:03.653431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:03.655501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:03.656897 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a7c70c78-40a0-41ec-82b7-0596418896fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.411721 Sep 01 16:34:03.667009 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 104/206] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:03 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:03.672296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:03.673140 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:03.680449 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:03.681035 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:03.686064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:03.686064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:03.686064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:03.686064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:03.807592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:03.817720 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1d770e40-b8e0-4a4c-8d8a-7d221aaf43c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.366428 Sep 01 16:34:03.819012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 103/207] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:03 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:03.840288 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:03.841306 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:03.848476 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:03.849354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:03.849969 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:03.850829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:03.851618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:03.852252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:04.016324 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:04.030270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-db899d8e-fb8b-4093-b3b8-f68fdba0b2c2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.209932 Sep 01 16:34:04.036385 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 104/208] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:03 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:04.041708 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:04.042553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:04.046224 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:04.049891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:04.051430 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:04.052146 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:04.052891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:04.053277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:04.053833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:04.063517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b71c4e8f-397b-4fc3-86e1-768aa3d6d6eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.387562 Sep 01 16:34:04.063517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 105/209] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:03 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:04.222023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:04.222023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b076535d-3e21-4b28-863a-d2a1a99fda9b tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.180851 Sep 01 16:34:04.222023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 105/210] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:04 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:04.681935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:04.682535 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:04.688373 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:04.688839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:04.689517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:04.690184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:04.690619 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:04.691025 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:04.838218 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:04.847124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:04.848183 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:04.848684 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:04.849416 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:04.850170 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-32431508-c4d4-4c80-8b80-f07bab35f2ee tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.173027 Sep 01 16:34:04.850738 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 106/211] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:04 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:04.856070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:04.856825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:04.857318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:04.858220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:04.858923 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:04.859432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:05.013599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:05.025729 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-62d86a4e-9aa4-4bf1-a4fe-80926a08bb03 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.178747 Sep 01 16:34:05.026727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 106/212] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:04 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:05.052839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:05.053437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:05.059849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:05.060374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:05.060834 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:05.061616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:05.062055 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:05.062472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:05.096773 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:05.097940 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:05.104682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:05.105255 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:05.105952 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:05.106639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:05.107089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:05.107720 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:05.240592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:05.250926 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-28122779-355b-463e-a130-42cfe0c1fe4a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.202407 Sep 01 16:34:05.251318 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 107/213] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:05 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:05.258186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:05.258814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:05.265012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:05.265531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:05.265987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:05.266695 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:05.267145 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:05.267609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:05.281996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:05.290550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-92200947-4951-4f00-8fea-16b7e98349c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.198718 Sep 01 16:34:05.291371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 107/214] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:05 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:05.413505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:05.421276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1d0920ce-d83d-427a-b8d2-98cba5a45191 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.168738 Sep 01 16:34:05.421855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 108/215] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:05 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:05.873653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:05.874260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:05.881673 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:05.882322 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:05.882768 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:05.883549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:05.883992 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:05.884386 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:06.046742 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:06.057801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:06.059274 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:06.060281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:06.060793 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3b14d032-f3f4-4e5b-abd2-ee8517afa261 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.190723 Sep 01 16:34:06.061010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:06.067850 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 108/216] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:05 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:06.068894 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:06.077863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:06.077863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:06.077863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:06.077863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:06.078192 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:06.226953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:06.230170 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-49e64da9-02ee-4cb2-9f82-67649a093c50 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.173677 Sep 01 16:34:06.231426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 109/217] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:06 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:06.274009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:06.274825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:06.278465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:06.282413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:06.282917 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:06.283415 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:06.284110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:06.284566 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:06.284976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:06.313089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:06.313814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:06.322203 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:06.323056 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:06.323809 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:06.325054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:06.325876 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:06.326639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:06.420508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:06.429028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7bc0b65b-bd0f-4a09-a9ee-7a41266d7192 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.159999 Sep 01 16:34:06.429649 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 109/218] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:06 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:06.444852 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:06.445446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:06.451232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:06.451708 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:06.452197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:06.452833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:06.453270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:06.453884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:06.469017 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:06.472693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:06.477673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3824b0f-5aaa-492f-90c4-78727d0400e7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.168378 Sep 01 16:34:06.478344 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 110/219] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:06 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:06.590109 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:06.598132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6837f94e-0126-410a-b5f3-c9580827583c tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.157663 Sep 01 16:34:06.598755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 110/220] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:06 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:07.084380 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:07.084976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:07.090912 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.091438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.091869 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.092579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.093031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.093447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.222340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:07.231275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:07.232756 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:07.233850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-962d4492-f612-488b-b38b-4fc78305166b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.153778 Sep 01 16:34:07.234405 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 111/221] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:07 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:07.252578 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:07.253200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:07.259183 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.259693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.260112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.260785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.261228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.261637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.390169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:07.398508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4fc5e36c-4280-4674-acd4-42c32d518c1d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.149902 Sep 01 16:34:07.399080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 111/222] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:07 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:07.451112 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:07.451730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:07.457595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.458742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.459360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.460041 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.460486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.460890 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.501177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:07.501912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:07.509175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.509748 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.510246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.511004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.511564 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.512045 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.601019 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:07.608895 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-91b82abe-6043-4156-af89-3f9259b9347f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.161506 Sep 01 16:34:07.609474 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 112/223] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:07 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:07.623820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:07.631474 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:07.631474 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.631682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.632116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.632811 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:07.633259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:07.633674 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:07.643949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:07.648083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:07.652595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e5916b2f-4ae7-4b92-8b92-1fafecf424ca tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.156424 Sep 01 16:34:07.653160 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 112/224] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:07 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:07.762654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:07.770983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0948898d-239b-4c2c-aae8-54906b554448 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.156461 Sep 01 16:34:07.771594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 113/225] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:07 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:08.257936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:08.258535 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:08.264705 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.265178 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.265599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.266311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.266756 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.267187 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.416516 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:08.421885 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:08.422961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:08.425665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:08.427894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:08.428935 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-932bd739-5385-4e4d-9e29-577ba6816099 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.176043 Sep 01 16:34:08.429496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 113/226] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:08 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:08.432230 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.432936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.433368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.434065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.434574 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.434990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.582113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:08.590039 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a006b598-43ae-48eb-9a58-d3676fd681f0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.173231 Sep 01 16:34:08.590617 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 114/227] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:08 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:08.629544 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:08.630217 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:08.636230 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.636709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.637137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.637833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.638279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.638694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.672838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:08.673445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:08.682563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.683054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.683510 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.684209 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.687329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.687329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.775925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:08.784425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9696c41b-1724-4ce9-b481-560084c3dda6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.158712 Sep 01 16:34:08.785025 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 114/228] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:08 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:08.792182 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:08.792879 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:08.799551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.800197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.800695 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.801475 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:08.802648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:08.803062 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:08.832299 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:08.850167 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b59a2030-98a9-46b2-89ae-003d829e49e3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.171507 Sep 01 16:34:08.851834 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 115/229] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:08 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:08.952973 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:08.961847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dee00e91-8c4d-4d5d-8241-b6c15afd4dc3 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.173548 Sep 01 16:34:08.962425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 115/230] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:08 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:09.453283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:09.453918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:09.460820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.461354 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.461738 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:09.462432 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.462910 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.463366 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:09.602677 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:09.610962 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:09.611672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:09.611868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:09.612692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:09.613841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-45e86346-3744-4c5a-8fc5-f1d0ec7a8cf0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.164566 Sep 01 16:34:09.614967 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 116/231] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:09 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:09.618747 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.619258 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.619685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:09.620380 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.620818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.621232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:09.754055 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:09.762022 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-338a17d7-398f-4772-a0de-181f0f725024 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.154995 Sep 01 16:34:09.762589 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 116/232] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:09 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:09.806505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:09.807019 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:09.813002 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.813501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.813921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:09.814859 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.815332 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.815742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:09.873292 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:09.873897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:09.884539 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.885016 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.885439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:09.886137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.886579 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.886988 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:09.950290 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:09.958736 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-323a1053-7831-492c-a36f-37ee11ffdf06 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.156782 Sep 01 16:34:09.959358 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 117/233] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:09 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:09.983086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:09.983863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:09.990547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.991026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.991486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:09.992186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:09.992634 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:09.993124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:10.026275 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:10.034832 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f97d29f5-438a-4337-b49f-b1cbfd01ae66 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.165995 Sep 01 16:34:10.039181 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 117/234] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:09 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:10.132059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:10.139743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bd5ad03a-69bf-4d45-add7-249f564f0579 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.160672 Sep 01 16:34:10.140333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 118/235] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:09 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:10.637276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:10.637794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:10.648961 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:10.649446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:10.649871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:10.650560 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:10.651000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:10.651472 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:10.782506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:10.783112 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:10.787200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:10.789891 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:10.790372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:10.790800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:10.791516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:10.791960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:10.792372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:10.795707 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:10.797144 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:10.798252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ffba111e-74b5-4739-8b74-972aacdca69f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.165052 Sep 01 16:34:10.798806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 118/236] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:10 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:10.934658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:10.943501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9dbb85c5-4f71-4aca-8c63-fb7848eef6dd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.165002 Sep 01 16:34:10.954208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 119/237] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:10 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:10.980060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:10.980682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:10.986843 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:10.987438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:10.987831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:10.988516 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:10.989004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:10.989563 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.056186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:11.056932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:11.060041 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:11.063785 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.064592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.065084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.065838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.066411 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.066895 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.134126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:11.149306 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-70910d3c-8b82-4142-9046-c262c8b37362 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.172490 Sep 01 16:34:11.150634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 119/238] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:10 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:11.170301 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:11.171494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:11.182091 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.182920 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.183731 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.184803 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.185701 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.186629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.219123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:11.227977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1d545ba3-0d99-443b-b887-c563b79c33ff tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.176015 Sep 01 16:34:11.228753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 120/239] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:11 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:11.330962 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:11.340027 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f4d489e9-19d8-41b4-9ed5-36d564184ced tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.175836 Sep 01 16:34:11.340607 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 120/240] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:11 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:11.822322 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:11.822846 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:11.828988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.829472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.829901 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.830599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.831044 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.831488 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.974875 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:11.975348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:11.978684 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:11.981557 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.982030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.982450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.983136 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:11.983597 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:11.984010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:11.992970 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:11.999416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:11.999416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b2baf14c-979c-4bca-ac1e-5ce3139f250a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.178710 Sep 01 16:34:11.999416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 121/241] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:11 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:12.119020 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:12.127205 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f4340365-33e7-4c52-89e9-818c58a5d4fb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.157012 Sep 01 16:34:12.127780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 121/242] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:11 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:12.178734 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:12.179390 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:12.185263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:12.185786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:12.186204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:12.186870 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:12.187339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:12.187745 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:12.249953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:12.250572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:12.258179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:12.258664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:12.259088 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:12.260058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:12.260520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:12.260942 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:12.318140 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:12.326208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2dda8420-856c-40c1-9942-08178491d3a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.151728 Sep 01 16:34:12.326788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 122/243] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:12 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:12.361146 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:12.361762 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:12.368870 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:12.369529 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:12.369966 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:12.370722 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:12.371266 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:12.371749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:12.397273 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:12.405591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4264c795-4637-43b9-a55c-a7af56d35f80 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.160715 Sep 01 16:34:12.406179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 122/244] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:12 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:12.500712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:12.509314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c4531df6-b0cf-42c4-9c1e-18a14d7c641e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.152079 Sep 01 16:34:12.509880 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 123/245] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:12 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:13.029203 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:13.029800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:13.036007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.036476 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.036930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.037941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.038334 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.038751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.148465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:13.149073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:13.156684 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.157637 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.157637 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.158338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.158778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.160959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.176351 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:13.188881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:13.201005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:13.201005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fe5af0b8-fd31-49fe-9d12-44304f49489c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.167393 Sep 01 16:34:13.201005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 123/246] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:13 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:13.316564 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:13.325254 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-62ef8f19-f6fd-413b-a2c4-f6397fc95b2f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.180803 Sep 01 16:34:13.325828 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 124/247] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:13 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:13.347709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:13.348372 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:13.354525 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.355009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.355476 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.356170 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.356617 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.357088 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.425955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:13.426851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:13.433649 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.434382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.434806 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.435518 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.435960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.436364 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.493640 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:13.501472 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8cd078ff-1bc1-462d-aab9-93fd5243a0fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.157622 Sep 01 16:34:13.502062 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 124/248] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:13 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:13.529730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:13.530347 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:13.536654 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.537652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.538078 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.538871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:13.539354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:13.539772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:13.583759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:13.591571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2f92cf95-4a7c-44ba-af98-728028950176 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.169437 Sep 01 16:34:13.592149 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 125/249] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:13 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:13.687427 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:13.697131 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-526f8a62-6fa8-483a-983d-52fd84e1af18 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.171136 Sep 01 16:34:13.697706 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 125/250] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:13 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:14.219556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:14.220353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:14.227172 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.227669 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.228099 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.233451 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.233451 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.233451 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.345885 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:14.346471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:14.353495 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.353966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.354499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.355416 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.355871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.356270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.366810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:14.375349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:14.376888 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:14.378074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f63cbe2f-7bfa-4b65-b13f-42c5c3a76478 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.162433 Sep 01 16:34:14.378720 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 126/251] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:14 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:14.490561 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:14.498645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8589c387-3c04-41b5-bc13-ad8358cfbae2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.156559 Sep 01 16:34:14.499250 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 126/252] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:14 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:14.527033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:14.528150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:14.538420 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.539286 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.540031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.541223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.542105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.542834 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.565640 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:14.613834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:14.614439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:14.621365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.621843 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.622272 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.622962 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.623434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.623852 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.688769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:14.698488 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-822375a4-9c3e-49b2-ba52-d954f2759d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.179212 Sep 01 16:34:14.699344 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 127/253] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:14 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:14.721821 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:14.722536 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:14.728861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.729561 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.729991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.730685 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:14.731131 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:14.731589 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:14.765237 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:14.773208 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b92092de-423e-4119-99d1-d101fc67edcc tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.163341 Sep 01 16:34:14.774048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 127/254] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:14 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:14.885483 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:14.893510 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-60b61faf-f2d0-422a-bd14-f451c1fde9a5 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.175402 Sep 01 16:34:14.894099 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 128/255] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:14 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:15.411432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:15.414356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:15.426148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.427662 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.429883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.431612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.432876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.433835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.444093 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-39629636-b24b-4203-b6d6-20e19e7a81c1 req-1867c7a8-2358-4c6e-803f-05f058f6a0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9ab9d9-bf46-47be-a669-b7262afa36c5", "name": "network-vif-plugged", "status": "completed", "tag": "72a909ce-ea6e-4de0-9ca1-03139d0f535e"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:15.462317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-39629636-b24b-4203-b6d6-20e19e7a81c1 req-1867c7a8-2358-4c6e-803f-05f058f6a0b1 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.462808 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-39629636-b24b-4203-b6d6-20e19e7a81c1 req-1867c7a8-2358-4c6e-803f-05f058f6a0b1 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.463248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-39629636-b24b-4203-b6d6-20e19e7a81c1 req-1867c7a8-2358-4c6e-803f-05f058f6a0b1 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.481624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-39629636-b24b-4203-b6d6-20e19e7a81c1 req-1867c7a8-2358-4c6e-803f-05f058f6a0b1 service nova] Creating event network-vif-plugged:72a909ce-ea6e-4de0-9ca1-03139d0f535e for instance 4f9ab9d9-bf46-47be-a669-b7262afa36c5 on hv-cinder-83602 Sep 01 16:34:15.490521 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-39629636-b24b-4203-b6d6-20e19e7a81c1 req-1867c7a8-2358-4c6e-803f-05f058f6a0b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053335 Sep 01 16:34:15.491658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 129/256] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:15.525562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:15.526540 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:15.533846 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.534336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.534761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.535570 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.535961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.536403 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.699692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:15.707884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-518cf69a-f7c1-4c3c-b714-7ac27ee3527b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.187977 Sep 01 16:34:15.725450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:15.725668 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 130/257] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:15 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:15.729916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:15.730524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:15.733866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:15.735662 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:15.736685 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.737000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ac0931a0-6b1f-4312-8a9d-92603011a1f2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.338417 Sep 01 16:34:15.737166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.737628 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.737751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 128/258] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:15 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:15.738314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.738757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.739204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.794959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:15.795913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:15.816864 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.820185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.820914 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.822636 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.823505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.824215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.864128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:15.899394 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:15.910764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d7f54c98-ce26-4b44-9d62-f381dd6aec7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.184270 Sep 01 16:34:15.911782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 131/259] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:15 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:15.923186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:15.924618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:15.935088 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.935984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.936727 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:15.938136 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:15.938833 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:15.940269 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.007521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:16.016800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d017e905-6dc4-4843-8e83-baf4138e16af tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.225533 Sep 01 16:34:16.017672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 129/260] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:15 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:16.104121 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:16.111791 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-747de9d2-951f-429e-a6ce-22b4ed6c567d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.196698 Sep 01 16:34:16.116539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 132/261] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:15 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:16.731957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:16.732579 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:16.738915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.760600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.760600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.760600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.760600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.761007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.761083 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:16.761508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:16.767373 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.767857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.768285 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.768972 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.769444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.769859 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.899684 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:16.905167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9de0e921-a5b0-45fd-bf06-26d233d71d13 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.177382 Sep 01 16:34:16.906376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 130/262] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:16 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:16.934862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:16.935699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:16.942571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.944171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.944851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.945856 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:16.946515 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:16.947137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:16.955665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:16.967406 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:16.968486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:16.970432 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-279f3589-d05e-48dd-85d5-8206efb359df tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.213689 Sep 01 16:34:16.981200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 133/263] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:16 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:17.042023 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:17.042023 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:17.047181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:17.047717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:17.048094 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:17.048788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:17.049226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:17.049638 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:17.164360 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:17.204202 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-985651ac-4df2-472f-9cc2-796614b07d3b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.272492 Sep 01 16:34:17.208215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 131/264] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:16 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:17.213532 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:17.232521 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2def7a33-a6ab-440f-b3e3-c41c2edd7fba tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.198028 Sep 01 16:34:17.234654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 134/265] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:17 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:17.240437 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:17.245652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:17.258747 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:17.259863 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:17.261876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:17.263736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:17.264501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:17.264975 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:17.415767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:17.424369 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-556a48a9-6ca8-4bce-ab7b-f082f9e82cda tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.197800 Sep 01 16:34:17.424954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 132/266] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:17 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:17.508431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-090a68ee-5338-47a7-8df4-5033384f6015 req-ec227017-d08d-449e-94d6-b89c4ca9bf6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd400b6-5c1a-4460-9cc0-275782d91b4a", "name": "network-vif-plugged", "status": "completed", "tag": "ac74679f-5302-4fd4-945b-001fa0f572f7"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:17.518309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-090a68ee-5338-47a7-8df4-5033384f6015 req-ec227017-d08d-449e-94d6-b89c4ca9bf6b service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:17.519189 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-090a68ee-5338-47a7-8df4-5033384f6015 req-ec227017-d08d-449e-94d6-b89c4ca9bf6b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:17.519610 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-090a68ee-5338-47a7-8df4-5033384f6015 req-ec227017-d08d-449e-94d6-b89c4ca9bf6b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:17.531644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-090a68ee-5338-47a7-8df4-5033384f6015 req-ec227017-d08d-449e-94d6-b89c4ca9bf6b service nova] Creating event network-vif-plugged:ac74679f-5302-4fd4-945b-001fa0f572f7 for instance dfd400b6-5c1a-4460-9cc0-275782d91b4a on hv-cinder-83602 Sep 01 16:34:17.539596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-090a68ee-5338-47a7-8df4-5033384f6015 req-ec227017-d08d-449e-94d6-b89c4ca9bf6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036412 Sep 01 16:34:17.540209 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 135/267] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:17.928938 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:17.929755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:17.937010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:17.937383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:17.937806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:17.938495 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:17.938929 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:17.939710 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:17.997538 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:17.998239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:18.005094 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.005742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.006215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.007045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.007526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.007944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.133961 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:18.142364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1842eb93-ee44-4281-9948-ea61c36c503f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.218224 Sep 01 16:34:18.158897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 133/268] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:17 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:18.207293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:18.214589 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:18.216221 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:18.217408 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f2a52033-10a5-4939-bf2f-d873c13f3c20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.224974 Sep 01 16:34:18.217963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 136/269] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:17 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:18.236739 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:18.237391 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:18.244788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.245267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.245686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.246420 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.246870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.247312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.262264 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:18.263044 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:18.284932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.288331 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.288895 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.289854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.290357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.290883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.408646 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:18.417872 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-116d98a7-6d2a-42c7-9c68-414070d9b019 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.184974 Sep 01 16:34:18.419017 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 134/270] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:18 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:18.438778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:18.446871 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3a0d7dee-4a07-44a0-895a-2666b826222b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.188623 Sep 01 16:34:18.447060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:18.455303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:18.455459 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 137/271] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:18 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:18.457124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.457829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.458225 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.459469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:18.460094 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:18.460513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:18.607631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:18.616096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a0828105-4215-45dc-985f-952d66fad998 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.173191 Sep 01 16:34:18.616691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 135/272] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:18 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:19.162810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:19.163440 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:19.169951 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.170476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.170906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.171835 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.172480 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.172800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.248565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:19.249781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:19.266458 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.266946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.267532 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.268509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.269171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.269777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.323827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:19.332495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c62f919f-e991-481a-a2fe-4ecfa7347322 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.173637 Sep 01 16:34:19.333302 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 138/273] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:19 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:19.430799 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:19.440954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:19.443611 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:19.443736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:19.443736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:19.445065 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-64ee30c4-e845-4965-a02b-fd0de0eb536a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.207514 Sep 01 16:34:19.445788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 136/274] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:19 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:19.448466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.449063 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.449495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.450189 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.450636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.451054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.469614 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:19.477959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:19.477959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.477959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.478426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.479091 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.479606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.480018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.596588 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:19.604314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-768262e1-900f-4fd8-b873-7a3230f37a49 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.168988 Sep 01 16:34:19.604896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 139/275] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:19 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:19.609706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-6e9e0334-6053-4ae5-91fd-20ee2b197016 req-299072b0-3acf-4190-ae22-a62cb0569fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f", "name": "network-vif-plugged", "status": "completed", "tag": "7528df97-c3e6-4a5e-8a1c-e62df28e6f83"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:19.619927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-6e9e0334-6053-4ae5-91fd-20ee2b197016 req-299072b0-3acf-4190-ae22-a62cb0569fe0 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.620661 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-6e9e0334-6053-4ae5-91fd-20ee2b197016 req-299072b0-3acf-4190-ae22-a62cb0569fe0 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.621079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-6e9e0334-6053-4ae5-91fd-20ee2b197016 req-299072b0-3acf-4190-ae22-a62cb0569fe0 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.638929 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-6e9e0334-6053-4ae5-91fd-20ee2b197016 req-299072b0-3acf-4190-ae22-a62cb0569fe0 service nova] Creating event network-vif-plugged:7528df97-c3e6-4a5e-8a1c-e62df28e6f83 for instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f on hv-cinder-83602 Sep 01 16:34:19.644566 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-6e9e0334-6053-4ae5-91fd-20ee2b197016 req-299072b0-3acf-4190-ae22-a62cb0569fe0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038505 Sep 01 16:34:19.645155 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 140/276] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:19.651181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:19.651930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:19.656204 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:19.663110 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.663110 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.663110 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.663110 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:19.663822 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:19.663822 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:19.668645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ba9ce41b-0fde-435c-8171-446d365cdf38 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.202519 Sep 01 16:34:19.669454 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 137/277] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:19 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:19.809778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:19.818823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6e4b86f1-23ff-410b-881d-28a1236c7b16 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.171746 Sep 01 16:34:19.819473 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 141/278] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:19 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:20.357097 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:20.358260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:20.364328 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.365580 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.365879 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.366669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.367116 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.367565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.470649 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:20.471379 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:20.478542 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.479024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.479487 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.480236 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.480842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.481259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.514968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:20.523914 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-31aa207d-a86f-4d26-9d1c-e1c9a4b996a6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.172239 Sep 01 16:34:20.527630 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 138/279] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:20 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:20.621788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:20.625987 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:20.626600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:20.635610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.635870 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:20.636000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.636000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.636000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.636000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.636433 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:20.636534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.636637 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-25e16739-1485-4d09-a1d6-81c72b74f532 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.170723 Sep 01 16:34:20.637453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 142/280] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:20 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:20.692399 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:20.693848 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:20.700586 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.701061 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.701484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.702338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.702792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.703233 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.821013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:20.829228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3a4ca0dd-adcc-4901-8dd8-be2cedb5a1d0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.206994 Sep 01 16:34:20.829823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 139/281] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:20 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:20.854248 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:20.854248 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:20.860035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.860524 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.860951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.861644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:20.862092 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:20.862508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:20.913215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:20.925409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6017a0c3-43e0-4976-a002-16814edf80f6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.236938 Sep 01 16:34:20.939924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 143/282] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:20 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:21.039053 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:21.048759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fb7168a8-f8bd-4a8e-99fb-4c243a9db20e tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1315 microversion: 2.1 time: 0.203886 Sep 01 16:34:21.050037 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 140/283] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:20 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:21.548097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:21.548711 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:21.569142 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.571773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.572402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.575672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.576929 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.578942 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.668164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:21.668996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:21.677830 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.678429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.679609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.681700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.682171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.682585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.789417 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:21.797880 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-58931c16-0ba9-45f2-8948-1910fe565498 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.253693 Sep 01 16:34:21.798463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 144/284] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:21 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:21.856465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:21.857741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:21.869190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.870026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.870759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.871510 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.872128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.873075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.886831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:21.899890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:21.901896 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:21.903490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3a13d365-6b74-4270-9af1-7294e94dafe6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.242205 Sep 01 16:34:21.904451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 141/285] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:21 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:21.948877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:21.949584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:21.957566 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.958143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.959241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:21.960020 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:21.960601 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:21.961060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.058783 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:22.076500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-24968ac4-93a4-45b9-ba79-613f785d6586 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.225967 Sep 01 16:34:22.077391 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 145/286] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:21 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:22.082818 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:22.083451 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:22.091066 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.092026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.092623 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.094529 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.095200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.095955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.122473 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:22.125096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:22.132627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f2814724-5351-4dcb-9258-07f5250bd617 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.187543 Sep 01 16:34:22.133540 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 142/287] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:21 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:22.302350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:22.311073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c7eb926c-034d-49b8-9f63-07de45fe6175 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1501 microversion: 2.1 time: 0.232339 Sep 01 16:34:22.311721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 146/288] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:22 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1501 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:22.825629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:22.826621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:22.836428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.837167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.837824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.838867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.839633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.840232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.931759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:22.932596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:22.940226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.941080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.941720 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.942633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:22.944477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:22.945152 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:22.999780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.008335 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a1ebdeb3-09e9-4e77-9696-39fa6ff8aecf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.190180 Sep 01 16:34:23.008924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 143/289] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:22 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:23.089523 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.097957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:23.098666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:23.099849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.101821 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.103110 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-19860012-d4d6-4073-a46f-52c13623e67e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.178261 Sep 01 16:34:23.103835 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 147/290] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:22 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:23.105676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.106598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.107519 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.108590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.112218 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.112218 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.156021 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:23.179528 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:23.179528 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.179528 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.179528 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.185374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:23.185374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:23.185374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:23.331981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.345642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-73afff52-faf4-4e38-8aea-630b12a57e8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.251487 Sep 01 16:34:23.346237 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 144/291] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:23 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:23.392456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:23.401225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fab22b4d-7e42-40e0-b707-50ff99ffe331 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.249022 Sep 01 16:34:23.402204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 148/292] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:23 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:24.031087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:24.031967 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:24.039333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.039806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.040330 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.041010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.041479 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.041917 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.128360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:24.129099 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:24.135613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.136282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.136810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.137498 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.137939 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.138349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.175872 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.192313 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-450c2a1a-4694-44aa-a314-efa3f3eab226 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.165006 Sep 01 16:34:24.192910 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 145/293] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:24 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:24.287271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.308012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.308012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.308012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e21e0226-d5a0-4527-b42c-460d6d267c98 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.177144 Sep 01 16:34:24.308360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 149/294] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:24 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:24.369938 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:24.370701 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:24.377264 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.377700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.378123 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.379198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.379798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.380369 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.385613 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:24.424653 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:24.425646 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:24.432298 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.438753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.438753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.438753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:24.438753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:24.439417 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:24.589716 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.597642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-eefb47b6-589e-47e0-b53c-185131abbecf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.231446 Sep 01 16:34:24.598223 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 146/295] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:24 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:24.601132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:24.609082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-94f9fcf6-52f8-4644-ac51-009e51144e5d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.188942 Sep 01 16:34:24.609644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 150/296] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:24 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:25.213593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:25.214208 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:25.221371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.222102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.222526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.223509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.232976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.232976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.332430 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:25.341838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:25.351977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.352633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.353076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.353807 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.354251 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.354824 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.419696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.429751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-08a17839-2e8d-4e03-90d4-9de60abdf68b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.220144 Sep 01 16:34:25.430690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 147/297] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:25 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:25.516471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.525667 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.527124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.528234 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-09955c43-cd01-4056-b904-87cc348751a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.203516 Sep 01 16:34:25.528777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 151/298] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:25 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:25.619042 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:25.619751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:25.626676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.627174 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.627861 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.628876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.629519 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.629634 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:25.630239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:25.631071 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.640631 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.641115 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.641543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.642239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:25.642679 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:25.643091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:25.787655 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.795197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f3058ad1-60c7-4a13-93bd-39d68dfb6b7c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1322 microversion: 2.1 time: 0.180383 Sep 01 16:34:25.795770 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 148/299] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:25 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:25.825207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:25.833235 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f6ab1096-878a-4166-9120-4689d6b153e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.207091 Sep 01 16:34:25.834435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 152/300] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:25 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:26.455927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:26.456841 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:26.477205 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.477942 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.478526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.479411 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.480057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.480673 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.550898 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:26.551608 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:26.560200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.560688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.561135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.561814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.562502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.563913 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.644095 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:26.652903 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-08c9d6f3-509b-4cbe-88f1-6a72bb70e720 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.202961 Sep 01 16:34:26.654100 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 149/301] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:26 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:26.712195 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:26.721977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:26.723584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:26.724809 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0b86638c-e232-43c2-b432-d1b0c0a805ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.177758 Sep 01 16:34:26.726123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 153/302] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:26 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:26.817196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:26.817890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:26.824642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.825126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.825552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.826236 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.826677 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.827091 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.854625 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:26.855285 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:26.862032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.862543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.863365 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:26.863944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:26.865297 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:26.865884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.068726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:27.092583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1f5b14c0-bf7f-4b13-9eda-ff04e84133d7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1516 microversion: 2.1 time: 0.278386 Sep 01 16:34:27.095628 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 150/303] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:26 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:27.114521 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:27.123202 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:27.126163 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:27.129831 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-85cdce9a-8fa9-4f76-a088-647d27b242cf tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.279011 Sep 01 16:34:27.137781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 154/304] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:26 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:27.139847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.140422 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.141093 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.141902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.142350 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.142770 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.227485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lazy-loading 'flavor' on Instance uuid 4f9ab9d9-bf46-47be-a669-b7262afa36c5 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:34:27.591589 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-bd963531-f80c-4d88-ac30-93bd5066ad7c req-c230ad77-785f-4ca2-9642-93b786108446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9c562a4-a89a-4fb1-9f85-e9efa1183ff1", "name": "network-vif-plugged", "status": "completed", "tag": "ccc88b9b-88ad-4e4f-9efa-bcefeca59f9e"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:27.601796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-bd963531-f80c-4d88-ac30-93bd5066ad7c req-c230ad77-785f-4ca2-9642-93b786108446 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.602263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-bd963531-f80c-4d88-ac30-93bd5066ad7c req-c230ad77-785f-4ca2-9642-93b786108446 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.602716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-bd963531-f80c-4d88-ac30-93bd5066ad7c req-c230ad77-785f-4ca2-9642-93b786108446 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.614639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-bd963531-f80c-4d88-ac30-93bd5066ad7c req-c230ad77-785f-4ca2-9642-93b786108446 service nova] Creating event network-vif-plugged:ccc88b9b-88ad-4e4f-9efa-bcefeca59f9e for instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 on hv-cinder-83602 Sep 01 16:34:27.627459 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-bd963531-f80c-4d88-ac30-93bd5066ad7c req-c230ad77-785f-4ca2-9642-93b786108446 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039467 Sep 01 16:34:27.628217 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 155/305] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:34:27.686126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:27.686817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:27.695388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.696709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.697390 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.698167 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.698613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.699143 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.699951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ad9e11cc-726d-4f22-968f-587356f1fee9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5/action" status: 200 len: 32 microversion: 2.1 time: 0.580110 Sep 01 16:34:27.701024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 151/306] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:34:27 2022] POST /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5/action => generated 32 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 16:34:27.711880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:27.712649 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:27.719959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.720453 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.721055 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.721903 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.722641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.723138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.933943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:27.946990 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ffea874a-022b-426f-8781-a2c0c0153eaf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.240026 Sep 01 16:34:27.947627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 152/307] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:27 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:27.957480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:27.961994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:27.969015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.969953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.970451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:27.971355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:27.971840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:27.972269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.125155 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.134012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.135819 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.136953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-af3bea5c-94f1-4f2b-a0b1-57f81b082c15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.185050 Sep 01 16:34:28.137517 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 153/308] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:27 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:28.160208 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ceec7e55-ac02-4a45-85b0-f9675cf1e578 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1075d3ed-a905-480c-84d7-d4a117cf47ad"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:28.164419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ceec7e55-ac02-4a45-85b0-f9675cf1e578 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:28.172419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ceec7e55-ac02-4a45-85b0-f9675cf1e578 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.172905 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ceec7e55-ac02-4a45-85b0-f9675cf1e578 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.173339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ceec7e55-ac02-4a45-85b0-f9675cf1e578 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.174041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ceec7e55-ac02-4a45-85b0-f9675cf1e578 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.174490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ceec7e55-ac02-4a45-85b0-f9675cf1e578 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.175274 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ceec7e55-ac02-4a45-85b0-f9675cf1e578 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.185461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.200130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4945761a-f42e-49cf-b7ed-62f47adbaaae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.518800 Sep 01 16:34:28.200729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 156/309] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:27 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:28.219387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:28.220004 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:28.233583 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.234469 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.235908 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.236839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.237469 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.237884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.387765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:28.400470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9cab5ab9-452e-4b19-bf02-a551144292d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.191446 Sep 01 16:34:28.401689 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 157/310] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:28 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:28.968996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:28.975013 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:28.977040 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.977626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.978161 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.978875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.979374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.979790 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.131123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.142921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9a56a0fb-4b04-4df2-b470-307084bb6ad7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.176919 Sep 01 16:34:29.142921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 158/311] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:28 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:29.159978 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:29.160833 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:29.167492 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.167971 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.168405 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.169104 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.169552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.169975 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.349812 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.364415 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.367827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.369934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-75742338-2cbb-4996-98ed-8afad99602fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.213454 Sep 01 16:34:29.370887 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 159/312] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:29 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:29.380215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:29.381358 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:29.393853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.394744 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.395482 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.396823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.397636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.398374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.562005 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.571174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e4f604a-331e-44a7-994e-1e728007876e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.198703 Sep 01 16:34:29.571875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 160/313] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:29 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:29.576762 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:29.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:29.587628 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.588135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.588610 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.589279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.589991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.594210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.804075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:29.812144 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2e3e3cdb-50a7-4729-a90b-76c8d1d06ab1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.239068 Sep 01 16:34:29.812749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 161/314] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:29 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:30.163183 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:30.163853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:30.169740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.170217 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.170642 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.171457 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.171810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.172224 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.376607 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.385740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-53eca722-99ac-4b01-af3e-f352b39fe365 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.227017 Sep 01 16:34:30.386322 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 162/315] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:30 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:30.403865 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:30.404520 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:30.410694 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.411437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.412646 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.428243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.428742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.429208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.451065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:30.582813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.597847 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.600612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.601803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-25cf5cb5-1071-4146-be98-b588a93b73d1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1407 microversion: 2.20 time: 0.209393 Sep 01 16:34:30.602365 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 163/316] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:30 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:30.607016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:30.607943 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:30.623377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.624035 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.624556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.625518 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.626259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.626765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.772390 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:30.780244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7bad1a89-b15b-4044-9053-5ceabe204725 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1367 microversion: 2.1 time: 0.176797 Sep 01 16:34:30.780836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 164/317] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:30 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:30.839970 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:30.841113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:30.851317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.852291 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.853117 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.854015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.854579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.855341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.995071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.004692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c44c40d7-abef-4000-b8d9-b73fa3229323 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.173949 Sep 01 16:34:31.005197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 165/318] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:30 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:31.410897 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:31.414055 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:31.422075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.428542 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.429104 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.429951 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.430420 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.431124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.609849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.622137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1acf1bc5-888d-4027-8e5f-bb45774f764d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.216700 Sep 01 16:34:31.635177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 166/319] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:31 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:31.635177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:31.635177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:31.638819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.639356 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.641382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.641875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.642430 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.642773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.779902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.790682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.791985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:31.793137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-63d1004d-9519-45de-ac2e-cb58e1a2049f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1598 microversion: 2.20 time: 0.169105 Sep 01 16:34:31.793841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 167/320] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:31 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:31.812855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:31.813682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:31.820280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.830680 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.830680 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.830680 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:31.830680 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:31.831321 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.996840 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:32.005186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-01e53c12-fc7f-48a7-92ee-87fcb91ede1e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1557 microversion: 2.1 time: 0.196162 Sep 01 16:34:32.005854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 168/321] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:31 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1557 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:32.011102 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ef9bb2ba-896a-413f-80b0-40d6af0eab26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:32.011619 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ef9bb2ba-896a-413f-80b0-40d6af0eab26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:32.017445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9bb2ba-896a-413f-80b0-40d6af0eab26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.017917 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9bb2ba-896a-413f-80b0-40d6af0eab26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.018505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9bb2ba-896a-413f-80b0-40d6af0eab26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.019398 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9bb2ba-896a-413f-80b0-40d6af0eab26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.019990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9bb2ba-896a-413f-80b0-40d6af0eab26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.020616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9bb2ba-896a-413f-80b0-40d6af0eab26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.166574 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ef9bb2ba-896a-413f-80b0-40d6af0eab26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.159337 Sep 01 16:34:32.167410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 169/322] 10.222.0.16 () {60 vars in 1316 bytes} [Thu Sep 1 16:34:32 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:34:32.173143 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:32.173748 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:32.177355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:32.181912 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.182721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.183368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.184348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.185142 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.185722 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.526349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:32.528915 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb6dfa13-8733-4efe-9b3e-018f1e99449b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.359575 Sep 01 16:34:32.529837 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 170/323] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:32 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:32.534565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f81e1ebf-a66d-4a8d-85cb-a2aef940e3b1 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:32.535089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f81e1ebf-a66d-4a8d-85cb-a2aef940e3b1 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:32.544746 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f81e1ebf-a66d-4a8d-85cb-a2aef940e3b1 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.545230 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f81e1ebf-a66d-4a8d-85cb-a2aef940e3b1 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.545655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f81e1ebf-a66d-4a8d-85cb-a2aef940e3b1 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.546341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f81e1ebf-a66d-4a8d-85cb-a2aef940e3b1 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.546787 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f81e1ebf-a66d-4a8d-85cb-a2aef940e3b1 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.547286 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f81e1ebf-a66d-4a8d-85cb-a2aef940e3b1 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.628007 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f81e1ebf-a66d-4a8d-85cb-a2aef940e3b1 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097093 Sep 01 16:34:32.628602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 171/324] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 16:34:32 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:32.647323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:32.647707 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:32.654444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.655183 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.655832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.657010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.657782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.658346 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.867059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:32.881296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c7c72bc6-97cc-4194-a7e9-fd35ecd62fb7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.238453 Sep 01 16:34:32.881976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 172/325] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:32 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:33.235950 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ceec7e55-ac02-4a45-85b0-f9675cf1e578 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "POST /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.089375 Sep 01 16:34:33.245306 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 154/326] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:34:28 2022] POST /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6/os-volume_attachments => generated 194 bytes in 5101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:33.551217 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:33.552137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:33.561519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.562281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.562705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.563446 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.563888 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.564300 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.735200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.743918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3bce3dd3-2f44-4c84-b210-70ffa317f342 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.197255 Sep 01 16:34:33.744495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 173/327] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:33 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:33.906353 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:33.907502 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:33.918500 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.926619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.926619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.926619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.926619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.927959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.460667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.473384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-03f6d2d5-fb9a-49e3-9b6b-6f86991c68b6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.574466 Sep 01 16:34:34.476018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 155/328] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:33 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:34.765702 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:34.766424 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:34.774106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.774896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.775518 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.776429 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.776872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.777444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.933541 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.944830 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-05761105-e8f2-4e3c-be0e-7d799ef99bac tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1364 microversion: 2.1 time: 0.182927 Sep 01 16:34:34.945481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 174/329] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:34 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:35.216879 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-3f8d1302-17ad-42a3-a3ea-2c11600c1b07 req-f8d2bf37-5d41-4713-adcb-7362a9c2da07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f", "tag": "7528df97-c3e6-4a5e-8a1c-e62df28e6f83"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:35.227426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-3f8d1302-17ad-42a3-a3ea-2c11600c1b07 req-f8d2bf37-5d41-4713-adcb-7362a9c2da07 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.228079 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-3f8d1302-17ad-42a3-a3ea-2c11600c1b07 req-f8d2bf37-5d41-4713-adcb-7362a9c2da07 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.228688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-3f8d1302-17ad-42a3-a3ea-2c11600c1b07 req-f8d2bf37-5d41-4713-adcb-7362a9c2da07 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.242790 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-3f8d1302-17ad-42a3-a3ea-2c11600c1b07 req-f8d2bf37-5d41-4713-adcb-7362a9c2da07 service nova] Creating event network-changed:7528df97-c3e6-4a5e-8a1c-e62df28e6f83 for instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f on hv-cinder-83602 Sep 01 16:34:35.249522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-3f8d1302-17ad-42a3-a3ea-2c11600c1b07 req-f8d2bf37-5d41-4713-adcb-7362a9c2da07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036931 Sep 01 16:34:35.250398 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 156/330] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:35.508978 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:35.509591 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:35.520732 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.529749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.530312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.531138 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.531729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.532270 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.894161 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.906069 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6ed8dd94-493d-40fe-9ae2-188f61ec3be0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.401980 Sep 01 16:34:35.907767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 175/331] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:35 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:35.971262 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:35.974089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:35.985030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.985907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.986422 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.992542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.992542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.992542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.239054 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.247493 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fe33216e-13df-4480-a876-2706a88633c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1550 microversion: 2.1 time: 0.282519 Sep 01 16:34:36.259311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 157/332] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:35 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1550 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:36.275016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6a65a464-f679-44bb-9e91-766af4d131d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:36.275549 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6a65a464-f679-44bb-9e91-766af4d131d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:36.293064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a65a464-f679-44bb-9e91-766af4d131d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.293562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a65a464-f679-44bb-9e91-766af4d131d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.294006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a65a464-f679-44bb-9e91-766af4d131d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.298925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a65a464-f679-44bb-9e91-766af4d131d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.301171 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a65a464-f679-44bb-9e91-766af4d131d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.301663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a65a464-f679-44bb-9e91-766af4d131d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.491258 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6a65a464-f679-44bb-9e91-766af4d131d2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.222058 Sep 01 16:34:36.491855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 176/333] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 16:34:36 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:34:36.932532 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:36.934826 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:36.960508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=97 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:36.965646 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.966436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.970869 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.970869 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.971741 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.975314 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.281237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-4fd8bc17-fbd3-4d6c-9e0a-2f501357832a req-e65d73fd-4cf3-4eaf-b713-a6192f38723c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd400b6-5c1a-4460-9cc0-275782d91b4a", "tag": "ac74679f-5302-4fd4-945b-001fa0f572f7"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:37.306150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-4fd8bc17-fbd3-4d6c-9e0a-2f501357832a req-e65d73fd-4cf3-4eaf-b713-a6192f38723c service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.306639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-4fd8bc17-fbd3-4d6c-9e0a-2f501357832a req-e65d73fd-4cf3-4eaf-b713-a6192f38723c service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.307062 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-4fd8bc17-fbd3-4d6c-9e0a-2f501357832a req-e65d73fd-4cf3-4eaf-b713-a6192f38723c service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.322076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-4fd8bc17-fbd3-4d6c-9e0a-2f501357832a req-e65d73fd-4cf3-4eaf-b713-a6192f38723c service nova] Creating event network-changed:ac74679f-5302-4fd4-945b-001fa0f572f7 for instance dfd400b6-5c1a-4460-9cc0-275782d91b4a on hv-cinder-83602 Sep 01 16:34:37.328365 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-4fd8bc17-fbd3-4d6c-9e0a-2f501357832a req-e65d73fd-4cf3-4eaf-b713-a6192f38723c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055550 Sep 01 16:34:37.329704 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 177/334] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:37.472422 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:37.482327 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dcaf15b1-dcb3-4a1a-ae77-d21fb7f74d53 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.558280 Sep 01 16:34:37.499436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 158/335] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:36 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:38.518934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:38.524358 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:38.531444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.536418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.538148 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:38.539333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.540476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.541359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:39.040236 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.048006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-58139485-71a4-47eb-966c-35fe681384eb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.535756 Sep 01 16:34:39.048587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 178/336] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:38 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:39.285783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-acc36f99-b0b0-4fd9-ac3b-e338379f9e31 req-7643e7ad-a598-4520-a6f5-d0f35542f453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9c562a4-a89a-4fb1-9f85-e9efa1183ff1", "tag": "ccc88b9b-88ad-4e4f-9efa-bcefeca59f9e"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:39.298966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-acc36f99-b0b0-4fd9-ac3b-e338379f9e31 req-7643e7ad-a598-4520-a6f5-d0f35542f453 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:39.299767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-acc36f99-b0b0-4fd9-ac3b-e338379f9e31 req-7643e7ad-a598-4520-a6f5-d0f35542f453 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:39.300189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-acc36f99-b0b0-4fd9-ac3b-e338379f9e31 req-7643e7ad-a598-4520-a6f5-d0f35542f453 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:39.314432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-acc36f99-b0b0-4fd9-ac3b-e338379f9e31 req-7643e7ad-a598-4520-a6f5-d0f35542f453 service nova] Creating event network-changed:ccc88b9b-88ad-4e4f-9efa-bcefeca59f9e for instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 on hv-cinder-83602 Sep 01 16:34:39.322157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-acc36f99-b0b0-4fd9-ac3b-e338379f9e31 req-7643e7ad-a598-4520-a6f5-d0f35542f453 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040308 Sep 01 16:34:39.322979 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 159/337] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:34:40.071852 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:40.074214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:40.087825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.089109 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.090209 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.091826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.093030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.094021 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.413997 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.433725 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9d861538-95a4-4424-b7bc-67a24f521386 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.367528 Sep 01 16:34:40.446158 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 179/338] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:40 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:41.459848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:41.460540 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:41.466783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.467303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.467732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.468415 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.468860 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.469307 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.616112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:41.619707 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:41.624128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-611e175a-33b6-4bce-b048-b57ec2da6eb4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.169905 Sep 01 16:34:41.624691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 160/339] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:41 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:42.645949 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:42.648381 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:42.663650 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.664220 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.665071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.665775 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.666387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.666805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.857392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:42.865797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f10e5e7b-fef6-4dcf-ac03-126808597af0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.223888 Sep 01 16:34:42.866685 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 180/340] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:42 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:43.887685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:43.888273 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:43.895588 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.896108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.896542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.897246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.897773 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.898148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.062374 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:44.071647 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-895712a6-5b44-4fea-afaa-7ab5eed19aed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.188229 Sep 01 16:34:44.072234 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 161/341] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:43 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:45.092636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:45.093272 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:45.099699 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.100243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.100663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.101720 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.102175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.102601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.247000 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:45.248793 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:45.254515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d7500175-3ff8-46d4-849e-78b9cea19c51 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.165570 Sep 01 16:34:45.255101 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 181/342] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:45 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:45.633414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:45.633922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:45.641143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.641626 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.642052 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.642743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.643224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.643702 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.669710 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:34:46.226427 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-33ed6e4d-fc67-4da6-a8bf-16d26966a7a4 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 204 len: 0 microversion: 2.1 time: 0.596156 Sep 01 16:34:46.228672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 162/343] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:34:45 2022] DELETE /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:34:46.239132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:46.250431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:46.250431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.250431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.250431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.251098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.251098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.251098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.277468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:46.287033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:46.287033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.287033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.287033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.287666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.287666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.287666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.434956 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.444858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ebbad302-910f-4c41-b580-d728bddae759 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1553 microversion: 2.1 time: 0.209394 Sep 01 16:34:46.445563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 182/344] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:46 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:46.463702 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.472060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9063e2aa-f1be-4707-88ab-a353d8a20621 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.199384 Sep 01 16:34:46.472575 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 163/345] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:46 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:47.471502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:47.472569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:47.482492 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.483316 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.484020 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.485173 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.485937 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.486637 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.495323 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:47.496041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:47.502928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.503768 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.504324 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.505013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.505936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.506352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.643185 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.653799 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c2e495de-1269-4f97-8c04-1db8eac34f52 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1553 microversion: 2.1 time: 0.189058 Sep 01 16:34:47.654609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 183/346] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:47 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:47.662044 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.671117 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-de9d1cf1-f145-41e2-978a-b93b1027300a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.180930 Sep 01 16:34:47.671807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 164/347] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:47 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:48.676129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:48.676839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:48.683991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.684467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.684893 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.685583 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.686027 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.686442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.700084 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:48.700726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:48.707712 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.708607 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.709317 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.711001 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.711819 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.712541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.854678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.872089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d4e6bd15-7c8e-424a-b996-fd9b342f4b20 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1553 microversion: 2.1 time: 0.199767 Sep 01 16:34:48.872709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 184/348] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:48 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:48.890658 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.903372 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e2d87db6-8bb5-49e2-a44e-f5d1dabd6899 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.206471 Sep 01 16:34:48.904048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 165/349] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:48 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:49.902886 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:49.903523 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:49.909473 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.909946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.910372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.911056 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.911594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.912004 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.924781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:49.928979 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:49.932521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.933009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.933441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.934138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.934593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.935126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.104931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:50.113340 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6a1d2732-4e8e-41fd-8eb3-0b5341eba605 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.192582 Sep 01 16:34:50.114134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 166/350] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:49 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:50.159444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:50.171570 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-30cb90b2-f7ba-46ef-a146-140835734144 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1553 microversion: 2.1 time: 0.273304 Sep 01 16:34:50.175295 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 185/351] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:49 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1553 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:50.175464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-ff937740-fea1-42ed-b880-083fd02d24d5 req-ade58fe8-c681-4d18-9843-840f65e8e265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef204bf-186e-4c11-81b9-e7a1470f9be6", "name": "network-vif-deleted", "tag": "6a4a674f-828e-4f19-a547-ea249ae3ee42"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:50.187782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-ff937740-fea1-42ed-b880-083fd02d24d5 req-ade58fe8-c681-4d18-9843-840f65e8e265 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:50.188724 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-ff937740-fea1-42ed-b880-083fd02d24d5 req-ade58fe8-c681-4d18-9843-840f65e8e265 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:50.195064 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-ff937740-fea1-42ed-b880-083fd02d24d5 req-ade58fe8-c681-4d18-9843-840f65e8e265 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.202857 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-ff937740-fea1-42ed-b880-083fd02d24d5 req-ade58fe8-c681-4d18-9843-840f65e8e265 service nova] Creating event network-vif-deleted:6a4a674f-828e-4f19-a547-ea249ae3ee42 for instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 on hv-cinder-83602 Sep 01 16:34:50.208414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-ff937740-fea1-42ed-b880-083fd02d24d5 req-ade58fe8-c681-4d18-9843-840f65e8e265 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039452 Sep 01 16:34:50.209372 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 167/352] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:51.136708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:51.137344 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:51.143399 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.143873 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.144300 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.144976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.145414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.145825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.197466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:51.198240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:51.205315 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.205800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.206256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.206988 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.207536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.208000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.278570 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.279573 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.280194 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.280808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lazy-loading 'fault' on Instance uuid 6ef204bf-186e-4c11-81b9-e7a1470f9be6 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:34:51.321247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:51.337947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aaf52d43-1a16-4225-b84b-6329f5b23d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.199036 Sep 01 16:34:51.337947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 186/353] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:51 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:51.366196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:51.379300 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9b3b183c-2b20-4748-99d9-7b0623aeda1d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1351 microversion: 2.1 time: 0.184291 Sep 01 16:34:51.379300 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 168/354] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:51 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1351 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:52.358794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:52.359522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:52.365886 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.366365 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.366784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.367506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.367951 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.369099 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.398052 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:52.398766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:52.409514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.410224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.410754 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.411504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.412309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.412972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.451251 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.451976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.452551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.453141 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lazy-loading 'fault' on Instance uuid 6ef204bf-186e-4c11-81b9-e7a1470f9be6 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:34:52.525261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662f85837db7411e8695d971413fc5ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c504a04e6b84427b9732157524a4aeef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.538207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a3f45569-0434-4892-9556-688d2c70b1a8 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 200 len: 1351 microversion: 2.1 time: 0.144150 Sep 01 16:34:52.539617 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 169/355] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:52 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 1351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:52.558275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.568095 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-427ae126-3556-48e0-b51e-7a6385571592 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.212990 Sep 01 16:34:52.568400 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 187/356] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:52 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:53.560492 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:53.561106 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:53.567780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.568259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.568692 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.569384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.569835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.570256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.585007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] HTTP exception thrown: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.590124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Request method failure captured: Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 HTTP/1.1 Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7Fpeye5921kTK0VyZKs6ASY1DAdD_lJ0lp84vdbVaabDitusPegK2AFEi2PEWuhLT0woAN7OE2JyFbd84GhrYSBMXnH-mkPv4yLnPP9FGYishcPEZvUTkhjBkdHPEc0Lv4SWToEXRcLfWK14PvnRqEJyxLtws7wTrd-gJUpDixSAs Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: c504a04e6b84427b9732157524a4aeef Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:34:53.590688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c504a04e6b84427b9732157524a4aeef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: c504a04e6b84427b9732157524a4aeef Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-DeleteServersTestJSON-1293675073-project Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 662f85837db7411e8695d971413fc5ba Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-DeleteServersTestJSON-1293675073-project Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.592171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '6ef204bf-186e-4c11-81b9-e7a1470f9be6'} Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:53.593082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.594319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.595851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:53.595946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Returning 404 to user: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:53.595946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6251ed8b-5bf5-4b26-ade7-0df861874269 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 404 len: 111 microversion: 2.1 time: 0.035392 Sep 01 16:34:53.595946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 170/357] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:53 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:34:53.597524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.597908 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.598703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.599433 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.599876 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.600770 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.721350 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:53.723737 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:53.732620 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.733127 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.733556 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.734251 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.734698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.735113 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.748461 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] HTTP exception thrown: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Request method failure captured: Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6/os-volume_attachments HTTP/1.1 Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7Fpeye5921kTK0VyZKs6ASY1DAdD_lJ0lp84vdbVaabDitusPegK2AFEi2PEWuhLT0woAN7OE2JyFbd84GhrYSBMXnH-mkPv4yLnPP9FGYishcPEZvUTkhjBkdHPEc0Lv4SWToEXRcLfWK14PvnRqEJyxLtws7wTrd-gJUpDixSAs Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: c504a04e6b84427b9732157524a4aeef Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:34:53.750847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c504a04e6b84427b9732157524a4aeef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: c504a04e6b84427b9732157524a4aeef Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-DeleteServersTestJSON-1293675073-project Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 662f85837db7411e8695d971413fc5ba Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-DeleteServersTestJSON-1293675073-project Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.759812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'server_id': '6ef204bf-186e-4c11-81b9-e7a1470f9be6'} Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:53.760572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:53.761618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:53.762719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Returning 404 to user: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:53.762719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ef77656e-936c-4670-971d-41b25f03072d tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035449 Sep 01 16:34:53.762719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 171/358] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:34:53 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:34:53.762999 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:53.768323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b2bcc5f-a72b-4d42-ab81-4fde22e529f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.182287 Sep 01 16:34:53.768900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 188/359] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:53 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:54.792274 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:54.793487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:54.804698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.806673 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.807521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.808502 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.809352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.810293 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.996062 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.004938 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0bd1ffec-73b1-46dd-80a6-4d4f18e18221 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.218269 Sep 01 16:34:55.005828 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 172/360] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:54 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:55.140048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:55.140530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:55.147470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.148141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.148627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.150079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.150703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.151342 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.167409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] HTTP exception thrown: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Request method failure captured: Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 HTTP/1.1 Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7Fpeye5921kTK0VyZKs6ASY1DAdD_lJ0lp84vdbVaabDitusPegK2AFEi2PEWuhLT0woAN7OE2JyFbd84GhrYSBMXnH-mkPv4yLnPP9FGYishcPEZvUTkhjBkdHPEc0Lv4SWToEXRcLfWK14PvnRqEJyxLtws7wTrd-gJUpDixSAs Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: c504a04e6b84427b9732157524a4aeef Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:34:55.172554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c504a04e6b84427b9732157524a4aeef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c504a04e6b84427b9732157524a4aeef Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-DeleteServersTestJSON-1293675073-project Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 662f85837db7411e8695d971413fc5ba Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-DeleteServersTestJSON-1293675073-project Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.173976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '6ef204bf-186e-4c11-81b9-e7a1470f9be6'} Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:55.174764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.176129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.177419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Returning 404 to user: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:55.177419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0f92b1d2-6343-499e-a722-d296ffdee668 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 404 len: 111 microversion: 2.1 time: 0.037937 Sep 01 16:34:55.177419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 189/361] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:34:55 2022] DELETE /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:34:55.182902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:55.183545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] [instance: 6ef204bf-186e-4c11-81b9-e7a1470f9be6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:55.189898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.190428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.191128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.192335 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.192429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.192833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.206985 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] HTTP exception thrown: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Request method failure captured: Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 HTTP/1.1 Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7Fpeye5921kTK0VyZKs6ASY1DAdD_lJ0lp84vdbVaabDitusPegK2AFEi2PEWuhLT0woAN7OE2JyFbd84GhrYSBMXnH-mkPv4yLnPP9FGYishcPEZvUTkhjBkdHPEc0Lv4SWToEXRcLfWK14PvnRqEJyxLtws7wTrd-gJUpDixSAs Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: c504a04e6b84427b9732157524a4aeef Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:34:55.208548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c504a04e6b84427b9732157524a4aeef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c504a04e6b84427b9732157524a4aeef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: c504a04e6b84427b9732157524a4aeef Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-DeleteServersTestJSON-1293675073 Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-DeleteServersTestJSON-1293675073-project Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 662f85837db7411e8695d971413fc5ba Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-DeleteServersTestJSON-1293675073-project Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.210043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '6ef204bf-186e-4c11-81b9-e7a1470f9be6'} Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:34:55.210955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. Sep 01 16:34:55.216304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:34:55.217627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] Returning 404 to user: Instance 6ef204bf-186e-4c11-81b9-e7a1470f9be6 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:34:55.217627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-015c2f0c-faee-4f50-8f5a-36125f88dfd1 tempest-DeleteServersTestJSON-1293675073 tempest-DeleteServersTestJSON-1293675073-project] 10.222.0.16 "GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6" status: 404 len: 111 microversion: 2.1 time: 0.031052 Sep 01 16:34:55.217627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 173/362] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:55 2022] GET /compute/v2.1/servers/6ef204bf-186e-4c11-81b9-e7a1470f9be6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:34:56.026940 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:56.027587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:56.034219 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.034700 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.035180 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.035893 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.036338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.036756 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.183565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.193187 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b3477681-cefb-4707-a473-b53a02cc7237 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.170819 Sep 01 16:34:56.195750 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 190/363] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:56 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:34:57.217085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:57.218907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:57.235686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.236419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.236995 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:57.237993 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.238518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.239009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:57.502310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:57.510588 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b328a8cb-20ec-455d-80fe-b0ee3001aa78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.299330 Sep 01 16:34:57.511202 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 174/364] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:57 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:58.515813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1831956346", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:58.539411 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:58.539411 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:58.555904 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:58.556643 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:58.557388 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:58.558075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:58.558645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:58.559075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:58.718976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:58.727076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-acc2ea0b-cf02-436f-aae9-bac5563795c0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.197584 Sep 01 16:34:58.728226 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 175/365] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:58 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:59.750084 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:59.750779 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:59.757596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.758115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.758549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:59.760552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.761005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.761423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.028064 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.039709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2c39af84-1018-46e0-9b81-e78d97828fd4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.293623 Sep 01 16:35:00.040914 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 176/366] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:59 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:01.070091 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:01.070691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:01.081665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.081665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.081665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.082236 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.082474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.085542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.252731 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.256466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:01.269696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f5db105a-5ee0-43ae-a33a-72607f4cd189 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.203885 Sep 01 16:35:01.271369 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 177/367] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:01 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:01.915790 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c6e7e8fe-d351-4fb3-91f4-29f3f3ae52fc tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Action: 'create', calling method: .version_select at 0x7fe37a17c430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2060250290", "metadata": {"Type": "work"}}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:02.501435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] validate_networks() for None {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:35:02.627491 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c6e7e8fe-d351-4fb3-91f4-29f3f3ae52fc tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.844507 Sep 01 16:35:02.628131 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 178/368] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 1 16:35:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 846 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 01 16:35:02.632931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:02.633695 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:02.641603 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.642089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.642528 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:02.643253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.643727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.644145 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:02.794024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:02.802615 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d6786f8f-9dd8-4f17-870a-58320a94560a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.173446 Sep 01 16:35:02.803220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 179/369] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:02 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:02.808267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0035fecd-6580-497c-ba36-2f523d2f1752 tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Calling method '.version_select at 0x7fe37a463c10>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:02.861679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0035fecd-6580-497c-ba36-2f523d2f1752 tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705" status: 200 len: 353 microversion: 2.1 time: 0.057321 Sep 01 16:35:02.862384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 180/370] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:35:02 2022] GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:03.066988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:35:03.067425 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:35:03.068092 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:35:03.068522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:35:03.069038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:35:03.072149 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=43 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:03.080686 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.081173 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.081599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.082315 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.082761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.083640 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.100825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Getting quotas for project 22dcb2335f19495e91b8de154d2110ac. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:35:03.107794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Getting quotas for user a8a6a1293fe44530a07d8bc4b0f74613 and project 22dcb2335f19495e91b8de154d2110ac. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:35:03.120196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:35:03.122478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:35:03.349753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-768465e1-c216-4409-bdc4-907a5879f37c tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.838882 Sep 01 16:35:03.350510 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 191/371] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:34:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:35:03.362679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e15f60d0-ed08-40e8-83a0-642aa7d8eddd tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:03.363900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e15f60d0-ed08-40e8-83a0-642aa7d8eddd tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:03.430480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e15f60d0-ed08-40e8-83a0-642aa7d8eddd tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:03.439484 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e15f60d0-ed08-40e8-83a0-642aa7d8eddd tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1215 microversion: 2.1 time: 0.081433 Sep 01 16:35:03.440084 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 181/372] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:03 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:03.826917 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:03.827546 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:03.833934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.834410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.834838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.835610 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.836058 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.836470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.876808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7902ce0d-5337-4977-84ef-b8efd9607e1a tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Calling method '.version_select at 0x7fe37a25eee0>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:03.933549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7902ce0d-5337-4977-84ef-b8efd9607e1a tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705" status: 200 len: 353 microversion: 2.1 time: 0.060897 Sep 01 16:35:03.934353 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 182/373] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:35:03 2022] GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:03.989544 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:03.999725 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-db190696-f22b-49f8-86a8-6bf706c67b61 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.177336 Sep 01 16:35:04.000496 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 192/374] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:03 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:04.462671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-90328162-6b74-415e-917d-0b7468ac1ca7 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:04.463314 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-90328162-6b74-415e-917d-0b7468ac1ca7 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:04.517206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-90328162-6b74-415e-917d-0b7468ac1ca7 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:04.525870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-90328162-6b74-415e-917d-0b7468ac1ca7 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1215 microversion: 2.1 time: 0.068226 Sep 01 16:35:04.526447 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 183/375] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:04 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:04.957009 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9db75aad-051b-4565-bf72-ff380f2286c4 tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Calling method '.version_select at 0x7fe37a216160>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.021851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.022567 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:05.030242 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.030609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9db75aad-051b-4565-bf72-ff380f2286c4 tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705" status: 200 len: 354 microversion: 2.1 time: 0.080982 Sep 01 16:35:05.030770 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.030945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 193/376] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:35:04 2022] GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:05.031259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.032032 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.032490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.032909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.052780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-251a69d2-74ef-46a1-957e-83d084720147 tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Calling method '.version_select at 0x7fe37a24a8b0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.106890 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-251a69d2-74ef-46a1-957e-83d084720147 tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705" status: 200 len: 354 microversion: 2.1 time: 0.058089 Sep 01 16:35:05.107721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 194/377] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:35:05 2022] GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:05.126945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9cef5451-4023-4efb-a138-b0e6dafc821c tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Calling method '.version_select at 0x7fe37a24af70>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.200490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:05.206639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-85ab69fd-7e41-43d0-9f03-1a09fcd44b09 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.189261 Sep 01 16:35:05.207256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 184/378] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:05 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:05.526505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9cef5451-4023-4efb-a138-b0e6dafc821c tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705" status: 202 len: 0 microversion: 2.1 time: 0.398723 Sep 01 16:35:05.526505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 195/379] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:35:05 2022] DELETE /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:35:05.530462 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-01a1994d-edff-48c5-8cf0-a93612f13e91 tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Calling method '.version_select at 0x7fe37a161ca0>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.548191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.548784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:05.557432 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.558599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.568493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.568493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.568493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.568493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.585789 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-01a1994d-edff-48c5-8cf0-a93612f13e91 tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705" status: 200 len: 353 microversion: 2.1 time: 0.059089 Sep 01 16:35:05.586513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 185/380] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:35:05 2022] GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:05.636994 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:05.644976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aec8b7dc-78e1-4bc0-9f88-dafb87a3c177 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1219 microversion: 2.1 time: 0.100817 Sep 01 16:35:05.645548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 196/381] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:05 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:06.232717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:06.233366 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:06.239748 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.240234 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.243498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.243498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.243498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.243498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.434060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:06.445940 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d6507074-284b-47b5-beec-5acddfdda4fe tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.217246 Sep 01 16:35:06.447389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 186/382] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:06 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:06.601921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-22d42eed-4898-45f4-a444-159b733cfdff tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Calling method '.version_select at 0x7fe37a3aa5e0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:06.635960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-22d42eed-4898-45f4-a444-159b733cfdff tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] HTTP exception thrown: Volume 2b10c24a-c3b0-4299-a26e-d7d0720ef705 could not be found. Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-22d42eed-4898-45f4-a444-159b733cfdff tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Request method failure captured: Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705 HTTP/1.1 Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN81Pmdl-z_5NdzJR0ipUIdtNk5AdsEDgL9b0vDU0CWokrXL9Vs-wKLr4KU-nxwKGW3scN2l6zH-iuTSaPpk7PH4WXj0h1_eNsrRPw0bFLIL4m5iDwM8eSmvcX4Uxsr0Enqv0L_U4rci4KRY0ovOuCmll8u1WkJI7yO58_xVQE6A5R4 Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: af19a8ade9ac443a84bc73c65fe8b50c Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesGetTestJSON-1319308471 Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:35:06.642280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af19a8ade9ac443a84bc73c65fe8b50c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af19a8ade9ac443a84bc73c65fe8b50c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af19a8ade9ac443a84bc73c65fe8b50c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af19a8ade9ac443a84bc73c65fe8b50c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesGetTestJSON-1319308471 Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: af19a8ade9ac443a84bc73c65fe8b50c Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesGetTestJSON-1319308471 Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesGetTestJSON-1319308471-project Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 0393d4a271974edcbf36e003396e8d47 Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesGetTestJSON-1319308471-project Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Volume 2b10c24a-c3b0-4299-a26e-d7d0720ef705 could not be found. Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '2b10c24a-c3b0-4299-a26e-d7d0720ef705'} Sep 01 16:35:06.643839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b10c24a-c3b0-4299-a26e-d7d0720ef705 could not be found. (HTTP 404) (Request-ID: req-710c4c11-8a67-4f9c-9a58-23e0cc9ea0b0) Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:06.644836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:35:06.646547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b10c24a-c3b0-4299-a26e-d7d0720ef705 could not be found. Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:35:06.648820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b10c24a-c3b0-4299-a26e-d7d0720ef705 could not be found. Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b10c24a-c3b0-4299-a26e-d7d0720ef705 could not be found. Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-22d42eed-4898-45f4-a444-159b733cfdff tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] Returning 404 to user: Volume 2b10c24a-c3b0-4299-a26e-d7d0720ef705 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-22d42eed-4898-45f4-a444-159b733cfdff tempest-VolumesGetTestJSON-1319308471 tempest-VolumesGetTestJSON-1319308471-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705" status: 404 len: 109 microversion: 2.1 time: 0.047483 Sep 01 16:35:06.652384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 197/383] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:35:06 2022] GET /compute/v2.1/os-volumes/2b10c24a-c3b0-4299-a26e-d7d0720ef705 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:35:06.671005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:06.672066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:06.683085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.684302 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.684676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.685469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.685926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.686350 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.798887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:06.808543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-89fd2dcd-1cc7-4af3-a46d-adf1cd895cd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1267 microversion: 2.1 time: 0.145045 Sep 01 16:35:06.809759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 187/384] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:06 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:07.468760 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:07.469806 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:07.476253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:07.476739 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:07.477174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.478500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:07.478957 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:07.479398 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.676371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:07.689669 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-69d25aef-8ec6-4a32-bffc-89a17d0eb935 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1522 microversion: 2.1 time: 0.224346 Sep 01 16:35:07.695302 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 198/385] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:07 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:07.832708 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:07.833865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:07.840388 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:07.841957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:07.842641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:07.843080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.844045 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:07.844507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:07.844937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.946249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:07.959283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bf4dd1b5-c46f-44d0-b686-1171f1ed749b tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1267 microversion: 2.1 time: 0.130221 Sep 01 16:35:07.959998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 188/386] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:07 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:08.713277 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:08.713884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:08.720943 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:08.721512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:08.722048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:08.722852 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:08.723338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:08.723758 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:08.961532 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:08.971936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fdd6bfc3-0ce9-450d-8b70-4dc442b70fc9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1502 microversion: 2.1 time: 0.263371 Sep 01 16:35:08.983141 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:08.984445 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:08.987810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 199/387] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:08 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:09.001384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:09.002115 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:09.002815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.009564 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.009564 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.009564 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.009564 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.010014 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.010099 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.010099 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.010244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.010900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.011388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.011805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.081886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:09.093173 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8eb96428-3bd2-475d-9866-f2e4127d109f tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1275 microversion: 2.1 time: 0.116434 Sep 01 16:35:09.094143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 189/388] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:08 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1275 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:09.256848 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:09.265472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-96ce4144-1acf-416f-b2df-befdc808c98d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1517 microversion: 2.1 time: 0.273204 Sep 01 16:35:09.266042 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 200/389] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:08 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:10.116210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:10.117075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:10.125904 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:10.126478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:10.126982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:10.127844 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:10.128444 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:10.129019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:10.283490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:10.299559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a13292ac-a268-441b-b8a0-0b0c60c20593 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.181192 Sep 01 16:35:10.301935 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 190/390] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:10 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:11.280672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-82c62f06-3726-43d7-9c21-5ae74e6733ff req-dbb27c0a-b227-4cb6-8941-2912c3c1105b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f8d266-05fe-4a1e-8bea-11d4090cf2e1", "tag": "131139a7-9d98-44de-b2e6-c959bc7a0fea"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:11.290514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-82c62f06-3726-43d7-9c21-5ae74e6733ff req-dbb27c0a-b227-4cb6-8941-2912c3c1105b service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:11.291340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-82c62f06-3726-43d7-9c21-5ae74e6733ff req-dbb27c0a-b227-4cb6-8941-2912c3c1105b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:11.291763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-82c62f06-3726-43d7-9c21-5ae74e6733ff req-dbb27c0a-b227-4cb6-8941-2912c3c1105b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:11.302905 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-82c62f06-3726-43d7-9c21-5ae74e6733ff req-dbb27c0a-b227-4cb6-8941-2912c3c1105b service nova] Creating event network-changed:131139a7-9d98-44de-b2e6-c959bc7a0fea for instance 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 on hv-cinder-83602 Sep 01 16:35:11.308606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-82c62f06-3726-43d7-9c21-5ae74e6733ff req-dbb27c0a-b227-4cb6-8941-2912c3c1105b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031687 Sep 01 16:35:11.309499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 201/391] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:11.332013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:11.332728 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:11.340719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:11.341206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:11.341631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:11.342330 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:11.342772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:11.343210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:11.510538 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:11.518567 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-196ac624-2d18-48ff-a5f1-e5b1b3e58ede tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.192053 Sep 01 16:35:11.519171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 191/392] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:11 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:12.606840 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:12.607550 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:12.613726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:12.614202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:12.614633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:12.615424 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:12.615872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:12.616285 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:12.772862 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:12.785359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-47a08a09-f237-41e9-8be1-f0f135fab534 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.182869 Sep 01 16:35:12.786201 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 202/393] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:12 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:13.549755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:13.552119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:13.559432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.559913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.560345 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.563489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.563489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.563489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.586146 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lazy-loading 'flavor' on Instance uuid d4209cd9-68c3-4e8a-9c4c-d560a8d74045 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:13.814190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:13.815431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:13.817789 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:13.818446 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:13.824144 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.825846 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.825846 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.825846 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.826144 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.826558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.937014 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c30c582e-a8b7-4275-ba45-86c01f03614a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045/action" status: 200 len: 32 microversion: 2.1 time: 0.391232 Sep 01 16:35:13.937634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 192/394] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:35:13 2022] POST /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045/action => generated 32 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:35:13.947933 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:13.948794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:13.956541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.957780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.957780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.958155 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.958584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.959000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.965143 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:13.973039 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ac025c14-f083-49d8-ad59-61142bf44fd8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.162734 Sep 01 16:35:13.973614 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 203/395] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:13 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:14.096261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:14.104772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-19897ef8-99eb-4ded-835f-a8bcb64df0e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.161156 Sep 01 16:35:14.105360 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 193/396] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:13 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:14.995594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:14.996104 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:15.002202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.002682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.003116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.003830 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.004275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.004692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.023192 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:15.122476 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=4 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:15.128151 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:15.129042 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:15.138581 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.139640 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.140398 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.142321 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.142722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.143552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.221803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:15.230504 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-68d780fc-52dc-456a-8423-144a35136a07 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.239700 Sep 01 16:35:15.231097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 204/397] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:14 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:15.292705 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:15.301404 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cb622a9a-793b-4356-ab07-32c1ea167549 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.179711 Sep 01 16:35:15.301984 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 194/398] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:15 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:16.252555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:16.253426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:16.259530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.260090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.260517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.261249 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.261820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.262243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.324289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:16.324898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:16.331559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.332044 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.332584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.333656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.336180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.336180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.418503 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:16.433499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0bf9d602-1b98-499a-a950-bca223b0f449 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.184574 Sep 01 16:35:16.433773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 205/399] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:16 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:16.492781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:16.501691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8427bcad-791d-4a00-bb26-486dc074762b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.181377 Sep 01 16:35:16.502197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 195/400] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:16 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:17.455951 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:17.456530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:17.463194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.463673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.464098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.464783 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.465225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.465643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.522563 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:17.523195 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:17.532178 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.533004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.533767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.535004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.535806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.536552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.613853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:17.622644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e80109e0-653f-408e-84d4-4b6b8f9df319 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.170293 Sep 01 16:35:17.623848 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 206/401] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:17 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:17.691028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:17.703644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cbcf09cb-4bc6-40e4-a3b9-989b1d42fdc5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.184650 Sep 01 16:35:17.705668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 196/402] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:17 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:18.644560 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:18.645219 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:18.651726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:18.652210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:18.652712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:18.653568 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:18.654019 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:18.654438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:18.733225 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:18.734429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:18.749017 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:18.750167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:18.756361 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:18.756361 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:18.756361 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:18.756361 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:18.819034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:18.838282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bfc7486d-dc6c-4673-bd64-f7eec3dff968 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.197794 Sep 01 16:35:18.842382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 207/403] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:18 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:18.917290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:18.925285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d0862c33-6190-4f60-98fc-fdbe111246fa tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.196177 Sep 01 16:35:18.925865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 197/404] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:18 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:19.861783 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:19.862407 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:19.869089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.869591 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.870016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.870704 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.871178 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.871584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.947461 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:19.948154 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:19.954887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.955425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.955854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.956572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.957104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.957496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.997851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:20.060633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:20.079892 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b56a7483-3788-451e-9b59-0d96c570d790 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.221610 Sep 01 16:35:20.081162 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 208/405] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:19 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:20.166052 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:20.173941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ca71117e-e70b-4a9f-a363-706f5660154f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.231844 Sep 01 16:35:20.174521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 198/406] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:19 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:20.771999 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-16f11ff2-b418-434d-b352-0566627b8e73 req-d25343a7-ef31-4bf7-bb47-793c4b5f86a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f8d266-05fe-4a1e-8bea-11d4090cf2e1", "name": "network-vif-plugged", "status": "completed", "tag": "131139a7-9d98-44de-b2e6-c959bc7a0fea"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:20.771999 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-16f11ff2-b418-434d-b352-0566627b8e73 req-d25343a7-ef31-4bf7-bb47-793c4b5f86a3 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:20.771999 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-16f11ff2-b418-434d-b352-0566627b8e73 req-d25343a7-ef31-4bf7-bb47-793c4b5f86a3 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:20.771999 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-16f11ff2-b418-434d-b352-0566627b8e73 req-d25343a7-ef31-4bf7-bb47-793c4b5f86a3 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.783442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-16f11ff2-b418-434d-b352-0566627b8e73 req-d25343a7-ef31-4bf7-bb47-793c4b5f86a3 service nova] Creating event network-vif-plugged:131139a7-9d98-44de-b2e6-c959bc7a0fea for instance 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 on hv-cinder-83602 Sep 01 16:35:20.788933 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-16f11ff2-b418-434d-b352-0566627b8e73 req-d25343a7-ef31-4bf7-bb47-793c4b5f86a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033069 Sep 01 16:35:20.789344 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 209/407] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:21.102272 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:21.103006 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:21.109837 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.110312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.110735 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.111447 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.111889 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.112300 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.203714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:21.205216 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:21.218601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.218601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.218601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.219407 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.220366 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.221267 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.371466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:21.380172 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-444fcb0d-5ea3-476d-9a39-c5fa638e2f08 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.282067 Sep 01 16:35:21.381179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 199/408] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:21 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:21.442481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:21.451223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8a1ce1a6-5358-4dd9-872d-d534769584a8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.256349 Sep 01 16:35:21.462632 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 210/409] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:21 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:22.413631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:22.414859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:22.422521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.423685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.423685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.424134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.424582 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.425002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.472940 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:22.473544 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:22.480859 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.481344 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.482411 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.482652 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.483088 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.483526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.598522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:22.607381 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8fa515e6-8270-4c9f-b919-ba9e4c8bfb67 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.197422 Sep 01 16:35:22.608336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 200/410] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:22 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:22.647332 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:22.656176 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7a9c17de-866b-4236-af8e-dfc810bb2499 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.187133 Sep 01 16:35:22.656740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 211/411] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:22 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:23.629171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:23.629771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:23.636547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:23.637023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:23.637453 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.638151 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:23.638655 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:23.639069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.684907 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:23.685560 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:23.692273 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:23.692826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:23.693329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.694283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:23.694803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:23.695340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.782403 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:23.787973 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-66843964-f574-452f-b12b-92c0c80e54ec tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1315 microversion: 2.1 time: 0.162663 Sep 01 16:35:23.801237 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 201/412] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:23 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:23.841195 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:23.848862 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-34085878-d7e3-4bb3-bb2a-66eccecc151a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.174754 Sep 01 16:35:23.849658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 212/413] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:23 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:24.809627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:24.810232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:24.816685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.817417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.817847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.818528 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.818977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.819454 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.872211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:24.873354 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:24.880653 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.881244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.881667 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.882353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.882797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.883221 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.959433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:24.971593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ab357706-1a30-4e2d-bc04-aed74145687e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1465 microversion: 2.1 time: 0.166448 Sep 01 16:35:24.972340 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 202/414] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:24 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:25.031258 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:25.031801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:25.038134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.038700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.039225 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.040005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.040745 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.041238 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.050076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:25.059741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ee2a9112-0b6a-48b2-af3d-1c4d232e3b86 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.193706 Sep 01 16:35:25.060314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 213/415] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:24 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:25.079911 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:35:25.636060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-36258ace-797a-453c-8d8f-f4078513fbd9 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 204 len: 0 microversion: 2.1 time: 0.611335 Sep 01 16:35:25.636678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 203/416] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:35:25 2022] DELETE /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:35:25.644937 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:25.645542 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:25.652431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.652911 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.653339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.654026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.654468 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.654899 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.823696 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:25.834223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-335d0c9a-ce73-49f4-9c27-85691248949d tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1471 microversion: 2.1 time: 0.193098 Sep 01 16:35:25.847870 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 214/417] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:25 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:26.089083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:26.089785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:26.096455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.096940 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.097376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.098081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.098533 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.098958 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.248198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:26.257710 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7f578884-6690-4079-b750-0dd8c30b9e10 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.173097 Sep 01 16:35:26.268631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 204/418] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:26 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:26.859135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:26.859760 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:26.866010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.871938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.871938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.871938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.871938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.872294 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.009671 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:27.017377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d8812d56-dcf0-4109-acdb-830e671c5c26 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1471 microversion: 2.1 time: 0.162027 Sep 01 16:35:27.017942 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 215/419] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:26 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:27.280840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:27.282319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:27.288023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.288497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.288977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.289652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.290115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.290829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.445102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:27.454123 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3d659380-34e7-4a81-97fc-86698c898379 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.177029 Sep 01 16:35:27.454822 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 205/420] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:27 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:28.040514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:28.042009 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:28.048700 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:28.049284 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:28.049780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:28.050732 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:28.051271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:28.051689 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:28.196943 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:28.205155 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-31da8d32-4358-45ce-a92d-f04aadac1692 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1471 microversion: 2.1 time: 0.169687 Sep 01 16:35:28.205889 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 216/421] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:28 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:28.396978 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-aa04a7b3-ec77-47e4-8d59-6335eb1c2c9d req-42632bb8-2341-4739-8ed8-e8abbd8f6419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f8d266-05fe-4a1e-8bea-11d4090cf2e1", "name": "network-vif-deleted", "tag": "131139a7-9d98-44de-b2e6-c959bc7a0fea"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:28.411862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-aa04a7b3-ec77-47e4-8d59-6335eb1c2c9d req-42632bb8-2341-4739-8ed8-e8abbd8f6419 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:28.412371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-aa04a7b3-ec77-47e4-8d59-6335eb1c2c9d req-42632bb8-2341-4739-8ed8-e8abbd8f6419 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:28.412996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-aa04a7b3-ec77-47e4-8d59-6335eb1c2c9d req-42632bb8-2341-4739-8ed8-e8abbd8f6419 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:28.426370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-aa04a7b3-ec77-47e4-8d59-6335eb1c2c9d req-42632bb8-2341-4739-8ed8-e8abbd8f6419 service nova] Creating event network-vif-deleted:131139a7-9d98-44de-b2e6-c959bc7a0fea for instance 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 on hv-cinder-83602 Sep 01 16:35:28.432873 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-aa04a7b3-ec77-47e4-8d59-6335eb1c2c9d req-42632bb8-2341-4739-8ed8-e8abbd8f6419 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042690 Sep 01 16:35:28.434383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 206/422] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:28.477258 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:28.478812 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:28.486339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:28.487293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:28.488040 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:28.489007 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:28.489714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:28.490478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:28.700466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:28.710502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5f9a4510-ae46-4e7e-9f86-6c1516e6ad3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.236545 Sep 01 16:35:28.711241 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 217/423] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:28 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:29.236895 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:29.237595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:29.249919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.249919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.250658 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.251042 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.251518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.252260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.295500 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.296344 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.296794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.297621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lazy-loading 'fault' on Instance uuid 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:29.370527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:29.371421 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cc623531-218b-4791-9727-db73a5b0ee1e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1305 microversion: 2.1 time: 0.138718 Sep 01 16:35:29.372083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 207/424] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:29 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:29.748712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:29.749328 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:29.755671 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.756146 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.756569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.757451 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.757898 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.758312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.934926 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:29.942825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5c85030a-6dc7-45ef-8ee4-27551013dc60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.201587 Sep 01 16:35:29.947943 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 218/425] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:29 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:30.399179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:30.401669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:30.409364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.409881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.410351 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.411125 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.411621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.412038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.450655 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.452573 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.452573 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.452573 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lazy-loading 'fault' on Instance uuid 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:30.499588 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:30.507366 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5c9108bc-a4d1-415f-8fd2-9f04b7a80d56 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1305 microversion: 2.1 time: 0.112125 Sep 01 16:35:30.507945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 208/426] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:30 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:30.964842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:30.965393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:30.971659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.972133 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.972557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.973243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.973691 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.974101 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.141293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:31.150997 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d15b84de-b208-4c74-946b-d840577b94ef tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.190542 Sep 01 16:35:31.151612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 219/427] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:30 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:31.528840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:31.529517 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:31.536868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.537625 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.539085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.541251 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.546392 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.547137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.588755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.589580 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.590341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.590944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lazy-loading 'fault' on Instance uuid 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:31.634475 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a6a1293fe44530a07d8bc4b0f74613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dcb2335f19495e91b8de154d2110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:31.642659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dcf75c72-e27f-434f-a9cd-6c7d152ab5e8 tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 200 len: 1305 microversion: 2.1 time: 0.117998 Sep 01 16:35:31.643466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 209/428] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:31 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:32.172965 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:32.172965 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:32.178803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.179339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.179688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.180665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.181335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.181844 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.344390 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:32.352455 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c865d111-4cc7-4e2e-8120-3489aa386732 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.184070 Sep 01 16:35:32.355368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 220/429] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:32 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:32.663877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:32.664474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] [instance: 11f8d266-05fe-4a1e-8bea-11d4090cf2e1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:32.672067 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.672539 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.672965 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.673642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.674087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.674498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.688042 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] HTTP exception thrown: Instance 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 could not be found. Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Request method failure captured: Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 HTTP/1.1 Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN8voJ45V48dc0aDgorA4w7lRZABksWXq_fjUrUsriJ1vFLvPttJR9qHXMK9k6ymJWTOp41L6VqJdbF0205jur3IFPlTSD9BoG9TqgEiS-BlyOw_FBvjPMbu04kBq7or8t9N6C-_dV5KZB4RlvrJXG_BzMeKILKQpUXAbbJv5-KL9ao Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 22dcb2335f19495e91b8de154d2110ac Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-VolumesNegativeTest-1228431745 Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:35:32.689730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_22dcb2335f19495e91b8de154d2110ac", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22dcb2335f19495e91b8de154d2110ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/22dcb2335f19495e91b8de154d2110ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22dcb2335f19495e91b8de154d2110ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-VolumesNegativeTest-1228431745 Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 22dcb2335f19495e91b8de154d2110ac Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-VolumesNegativeTest-1228431745 Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-VolumesNegativeTest-1228431745-project Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: a8a6a1293fe44530a07d8bc4b0f74613 Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-VolumesNegativeTest-1228431745-project Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 could not be found. Sep 01 16:35:32.700541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '11f8d266-05fe-4a1e-8bea-11d4090cf2e1'} Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 could not be found. Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:35:32.702024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 could not be found. Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 could not be found. Sep 01 16:35:32.703470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:32.704668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] Returning 404 to user: Instance 11f8d266-05fe-4a1e-8bea-11d4090cf2e1 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:35:32.704668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-25984b7a-e27d-4414-8343-74927c3a835e tempest-VolumesNegativeTest-1228431745 tempest-VolumesNegativeTest-1228431745-project] 10.222.0.16 "GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1" status: 404 len: 111 microversion: 2.1 time: 0.031374 Sep 01 16:35:32.704668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 210/430] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:32 2022] GET /compute/v2.1/servers/11f8d266-05fe-4a1e-8bea-11d4090cf2e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:35:33.377527 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:33.378181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:33.380289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:33.386682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:33.387184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:33.387813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:33.388830 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:33.389283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:33.389699 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:33.574612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:33.579488 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:33.585318 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0389f991-fd1e-4267-9ab7-66478a6d091c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.211598 Sep 01 16:35:33.586050 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 221/431] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:33 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:34.607598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:34.608277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:34.614985 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:34.615497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:34.616099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:34.616764 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:34.617177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:34.617589 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:34.802554 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:34.810990 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-36a70a7d-cf19-4392-9234-c8dd577538c6 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.208938 Sep 01 16:35:34.815734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 211/432] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:34 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:35.838958 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:35.840467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:35.849628 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.850179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.850548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.851346 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.851766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.852184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:36.265657 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:36.285290 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7aa6b473-46f6-48b6-8da5-e82ec6aaac6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.450759 Sep 01 16:35:36.299610 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 222/433] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:35 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:37.321728 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:37.322449 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:37.329541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:37.330134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:37.330644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:37.331377 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:37.331877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:37.332291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:37.483679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:37.506814 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9891e6d4-e915-4051-b89d-695b7133311b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.189053 Sep 01 16:35:37.507464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 212/434] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:37 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:38.528708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:38.529631 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:38.535728 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.536212 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.536638 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.537539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.537978 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.538392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.698184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:38.711286 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-709d1ee4-22a8-4f49-9c25-3f39491f2a87 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1503 microversion: 2.1 time: 0.187257 Sep 01 16:35:38.712553 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 223/435] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:38 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:38.737878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6c2adad-2238-4f46-be60-9adb06624777"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:38.741852 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:38.752885 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.753679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.754449 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.755777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.756606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.757384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.800656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] HTTP exception thrown: Cannot 'attach_volume' instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 while it is in vm_state rescued Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Request method failure captured: Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: POST /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045/os-volume_attachments HTTP/1.1 Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 74 Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN6_WXIC-4YN6U5LS5fcBrN0KP39ZYvQMD8k382YHVI5cm-TQjlHo434Iwnvp2M43ARHAt1XySyvgZfg-eLZWx-AsqeF_TeQMpbbefYTSKSZKNi-6Egiu0koZcd5nF49Z71Gs9TqbXZ6y86lUE-lrXeyHRcF1zBka3L9MIa8d37TEto Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:35:38.803514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f0958b1518e4439bf12959b7760abc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8937e9f80f1540e389ee283971624741 Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {"volumeAttachment": {"volumeId": "f6c2adad-2238-4f46-be60-9adb06624777"}} Sep 01 16:35:38.804867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Cannot 'attach_volume' instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 while it is in vm_state rescued Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'server_id': 'd4209cd9-68c3-4e8a-9c4c-d560a8d74045', 'body': {'volumeAttachment': {'volumeId': 'f6c2adad-2238-4f46-be60-9adb06624777'}}} Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:35:38.805537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 while it is in vm_state rescued Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:35:38.806609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:35:38.809627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:35:38.809627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:35:38.809627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 while it is in vm_state rescued Sep 01 16:35:38.809627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:35:38.809627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Returning 409 to user: Cannot 'attach_volume' instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 while it is in vm_state rescued {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:35:38.809627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8157248d-096a-42ce-bde5-a85942b0b33b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.075660 Sep 01 16:35:38.809627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 213/436] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:35:38 2022] POST /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045/os-volume_attachments => generated 152 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:35:38.815714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d687a1d4-839a-4f8b-92a4-a055abc9cb78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:38.816258 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d687a1d4-839a-4f8b-92a4-a055abc9cb78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:38.822812 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d687a1d4-839a-4f8b-92a4-a055abc9cb78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.823321 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d687a1d4-839a-4f8b-92a4-a055abc9cb78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.823743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d687a1d4-839a-4f8b-92a4-a055abc9cb78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.824419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d687a1d4-839a-4f8b-92a4-a055abc9cb78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.824878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d687a1d4-839a-4f8b-92a4-a055abc9cb78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.825269 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d687a1d4-839a-4f8b-92a4-a055abc9cb78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.159210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d687a1d4-839a-4f8b-92a4-a055abc9cb78 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045/action" status: 202 len: 0 microversion: 2.1 time: 0.347211 Sep 01 16:35:39.159964 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 224/437] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:35:38 2022] POST /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:35:39.169942 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:39.171040 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:39.173274 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:39.182540 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.182540 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.182540 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.182540 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.182897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.182897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.187995 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:39.354127 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:39.363401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-487ad509-7de1-4e01-9402-2782c6e98b6c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1511 microversion: 2.1 time: 0.198233 Sep 01 16:35:39.363995 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 214/438] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:39 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:39.476514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1647285687", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "networks": [{"uuid": "656dc81d-5348-4732-8b07-c30711591ca4"}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:39.551441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] validate_networks() for [('656dc81d-5348-4732-8b07-c30711591ca4', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:35:40.199028 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:35:40.199709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:35:40.200179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:35:40.200581 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:35:40.200987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:35:40.211036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:40.211691 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:40.212271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:40.213115 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:40.213662 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:40.214261 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:40.236156 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Getting quotas for project 98240e01aaa84f3e8c7e425ad2c9eb4f. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:35:40.241945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Getting quotas for user 3a32dcea37fb4255823fec5eb5c57e00 and project 98240e01aaa84f3e8c7e425ad2c9eb4f. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:35:40.254950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:35:40.257361 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:35:40.388606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:40.389452 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:40.396494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:40.396965 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:40.397439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:40.398144 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:40.398589 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:40.399015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:40.431414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-97346ece-0b11-40e9-9b61-948b83c4c2d3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951887 Sep 01 16:35:40.431414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 225/439] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:35:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:35:40.433168 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c2584430-4e74-4fdb-9b09-8bdc670a2c8d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:40.433476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c2584430-4e74-4fdb-9b09-8bdc670a2c8d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:40.501224 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c2584430-4e74-4fdb-9b09-8bdc670a2c8d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:40.511517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c2584430-4e74-4fdb-9b09-8bdc670a2c8d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1219 microversion: 2.1 time: 0.082133 Sep 01 16:35:40.513464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 226/440] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:40 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:40.562585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:40.571692 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d7652c52-261a-476e-8e84-256d65e5e20e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1511 microversion: 2.1 time: 0.188054 Sep 01 16:35:40.572386 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 215/441] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:40 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:41.541322 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3aaadbe1-2703-4b05-adf5-0436778fabad tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:41.541944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3aaadbe1-2703-4b05-adf5-0436778fabad tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:41.600627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:41.601411 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:41.609065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3aaadbe1-2703-4b05-adf5-0436778fabad tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:41.617006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3aaadbe1-2703-4b05-adf5-0436778fabad tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1219 microversion: 2.1 time: 0.081123 Sep 01 16:35:41.617588 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 227/442] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:41 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:41.631752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:41.632058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:41.632490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:41.633262 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:41.633759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:41.634339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:41.816999 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:41.827310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3a814564-60ee-4a43-8ba7-39aa98da3aba tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1511 microversion: 2.1 time: 0.236425 Sep 01 16:35:41.828457 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 216/443] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:41 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:42.638790 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:42.639867 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:42.655981 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.656562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.657189 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:42.657908 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.658362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.658792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:42.732763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:42.740248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ff497bf2-7cd9-49cb-b7dc-d07072c63396 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1223 microversion: 2.1 time: 0.105826 Sep 01 16:35:42.742556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 228/444] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:42 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:42.849378 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:42.849994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:42.857705 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.858456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.858891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:42.859639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.860089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.860513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:43.040600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:43.049734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1e9ce211-4a52-4fa0-86af-3a19c12877f8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1511 microversion: 2.1 time: 0.204091 Sep 01 16:35:43.050422 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 217/445] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:42 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:43.762730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:43.763497 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:43.769497 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:43.769985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:43.770416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:43.771107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:43.771572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:43.771989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:43.833867 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:43.841807 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e81d3c56-6229-4b52-a8ee-381d6d025649 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1215 microversion: 2.1 time: 0.083827 Sep 01 16:35:43.842370 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 229/446] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:43 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:44.073457 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:44.074871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:44.084314 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.084930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.085378 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:44.087125 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.087125 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.087125 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:44.223631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:44.233041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-51c9e798-f1da-4feb-a10e-202d03df0988 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1517 microversion: 2.1 time: 0.164078 Sep 01 16:35:44.233617 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 218/447] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:44 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:44.862817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:44.863844 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:44.869962 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.870449 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.870888 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:44.871638 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.872093 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.872506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:44.948210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:44.956513 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-57fade5d-b198-4f95-aa51-58092a757d8c tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1271 microversion: 2.1 time: 0.097686 Sep 01 16:35:44.957108 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 230/448] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:44 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:45.986446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:45.986446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:45.988181 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:45.988672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:45.989110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:45.989807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:45.990254 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:45.990846 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:46.054402 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:46.062750 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b6fa07f9-cc82-48fa-8055-85faaa5e0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1277 microversion: 2.1 time: 0.088318 Sep 01 16:35:46.063436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 219/449] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:45 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:47.086499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:47.087080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:47.093641 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.094113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.094533 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.095246 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.095695 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.096101 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.182644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5719ae5f-faa4-4810-8dd2-970d501b0319 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'create', calling method: .version_select at 0x7fe37a2fa550>, body: {"keypair": {"name": "tempest-keypair-547232865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYgV+nuguLtroM82JVnVeR/GBlXHXdLtum6Zf25/Zit9dtlcboJl1Aa/7YUIB+NKyVj9ahqHQz80+uZGnWzBDczzAyjOlO9bZvzmSnO2lu4odXX266FjEBgb99FrcToXw=="}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:47.199852 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-5719ae5f-faa4-4810-8dd2-970d501b0319 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Getting quotas for project 2f0958b1518e4439bf12959b7760abc4. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:35:47.204229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-5719ae5f-faa4-4810-8dd2-970d501b0319 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Getting quotas for user 8937e9f80f1540e389ee283971624741 and project 2f0958b1518e4439bf12959b7760abc4. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:35:47.239957 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:47.243453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d02759b8-e24e-4ffa-a05d-22535f93f0e8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.160774 Sep 01 16:35:47.256375 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 231/450] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:47 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:47.323241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5719ae5f-faa4-4810-8dd2-970d501b0319 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144457 Sep 01 16:35:47.332722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 220/451] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:35:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:47.614866 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-a6af1869-d8b3-4d9e-b861-ede15aca633e req-cf35663a-5edd-4cde-81e0-9dc679b7a82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c1f79f-e737-474c-baa4-da016497a1c6", "tag": "4f65a033-a5ab-4e8e-815d-247b4f5ed126"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:47.631643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a6af1869-d8b3-4d9e-b861-ede15aca633e req-cf35663a-5edd-4cde-81e0-9dc679b7a82a service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.632414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a6af1869-d8b3-4d9e-b861-ede15aca633e req-cf35663a-5edd-4cde-81e0-9dc679b7a82a service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.633386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a6af1869-d8b3-4d9e-b861-ede15aca633e req-cf35663a-5edd-4cde-81e0-9dc679b7a82a service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.652255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-a6af1869-d8b3-4d9e-b861-ede15aca633e req-cf35663a-5edd-4cde-81e0-9dc679b7a82a service nova] Creating event network-changed:4f65a033-a5ab-4e8e-815d-247b4f5ed126 for instance 31c1f79f-e737-474c-baa4-da016497a1c6 on hv-cinder-83602 Sep 01 16:35:47.663111 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-a6af1869-d8b3-4d9e-b861-ede15aca633e req-cf35663a-5edd-4cde-81e0-9dc679b7a82a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054556 Sep 01 16:35:47.664571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 232/452] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:48.270550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:48.271184 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:48.278860 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.279564 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.280827 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.281719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.282210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.282633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.421429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:48.452781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f51de897-09a2-4c85-96ec-9689501074d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.185452 Sep 01 16:35:48.452781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 221/453] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:48 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:49.473125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:49.473802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:49.483078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.483985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.484562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:49.485421 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.486031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.486651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:49.634317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:49.643247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-660dad2c-49de-4eaf-95e0-a585679afdba tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.174400 Sep 01 16:35:49.643830 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 233/454] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:49 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:50.526019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1882554100", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33d75bfb-4975-48d5-980c-d407446050dc"}], "security_groups": [{"name": "tempest-securitygroup--1125789911"}], "key_name": "tempest-keypair-547232865", "user_data": "}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:50.636541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] validate_networks() for [('33d75bfb-4975-48d5-980c-d407446050dc', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:35:50.665254 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:50.671292 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:50.671292 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:50.674993 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:50.675590 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:50.676159 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:50.677223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:50.677773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:50.678439 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:50.860012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:50.869357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-108f92ac-285e-4f21-95a4-5810cf4f6fde tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.208113 Sep 01 16:35:50.883009 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 234/455] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:50 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:51.088981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:35:51.089500 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:35:51.090730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:35:51.091722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:35:51.092328 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:35:51.101534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.102264 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.102844 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.103773 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.104385 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.104980 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.128834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Getting quotas for project 2f0958b1518e4439bf12959b7760abc4. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:35:51.133290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Getting quotas for user 8937e9f80f1540e389ee283971624741 and project 2f0958b1518e4439bf12959b7760abc4. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:35:51.146257 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:35:51.148734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:35:51.390337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-128a6f46-fea9-404b-b216-18a4a52d6254 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.868662 Sep 01 16:35:51.390910 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 222/456] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:35:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:35:51.401573 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9ca16dd1-26cc-4175-a96b-399d50d41436 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:51.405588 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9ca16dd1-26cc-4175-a96b-399d50d41436 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:51.457449 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9ca16dd1-26cc-4175-a96b-399d50d41436 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:51.464587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9ca16dd1-26cc-4175-a96b-399d50d41436 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1245 microversion: 2.1 time: 0.066699 Sep 01 16:35:51.477793 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 235/457] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:51 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:51.891783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:51.893237 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:51.905197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.909590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.909590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.909590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.909590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.909971 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:52.091894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:52.099851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bb2f779c-b519-47eb-8f98-34c68c631fa1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.213173 Sep 01 16:35:52.103002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 223/458] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:51 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:52.485867 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2a4cf55b-bcac-449b-a356-cd4b3142ed72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:52.486472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2a4cf55b-bcac-449b-a356-cd4b3142ed72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:52.556662 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2a4cf55b-bcac-449b-a356-cd4b3142ed72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:52.564558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2a4cf55b-bcac-449b-a356-cd4b3142ed72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1245 microversion: 2.1 time: 0.082519 Sep 01 16:35:52.565129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 236/459] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:52 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:53.126136 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:53.126760 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:53.133338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.133815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.134240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.134927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.135433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.135848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.296224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:53.304250 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f0acf920-9a60-466e-b42a-087d1890338f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.186224 Sep 01 16:35:53.304886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 224/460] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:53 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:53.589743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:53.590348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:53.596526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.597005 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.597432 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.598140 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.598582 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.599026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.661301 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:53.670067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6cc747b5-0e9e-461f-9705-b3808ace8b99 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1297 microversion: 2.1 time: 0.084052 Sep 01 16:35:53.671902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 237/461] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:53 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:54.325550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:54.326422 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:54.333108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.334331 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.334331 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.334709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.335181 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.335598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.478183 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:54.487708 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-27308bcc-abf6-4db3-94e0-7b188535bd6d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.166203 Sep 01 16:35:54.488355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 225/462] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:54 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:54.694257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:54.707784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:54.720117 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.722476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.723991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.727169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.728437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.729043 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.817441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:54.827569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f8ad1480-b514-4e2d-8f22-52669df85d5b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1305 microversion: 2.1 time: 0.138900 Sep 01 16:35:54.828137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 238/463] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:54 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:54.989556 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-8c1744a3-b7f8-41e4-a019-b2cf762b8ce7 req-ce9019ff-7351-428d-8e1d-986626709d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c1f79f-e737-474c-baa4-da016497a1c6", "name": "network-vif-plugged", "status": "completed", "tag": "4f65a033-a5ab-4e8e-815d-247b4f5ed126"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:55.000265 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-8c1744a3-b7f8-41e4-a019-b2cf762b8ce7 req-ce9019ff-7351-428d-8e1d-986626709d1b service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.001029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-8c1744a3-b7f8-41e4-a019-b2cf762b8ce7 req-ce9019ff-7351-428d-8e1d-986626709d1b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.001541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-8c1744a3-b7f8-41e4-a019-b2cf762b8ce7 req-ce9019ff-7351-428d-8e1d-986626709d1b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.014919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-8c1744a3-b7f8-41e4-a019-b2cf762b8ce7 req-ce9019ff-7351-428d-8e1d-986626709d1b service nova] Creating event network-vif-plugged:4f65a033-a5ab-4e8e-815d-247b4f5ed126 for instance 31c1f79f-e737-474c-baa4-da016497a1c6 on hv-cinder-83602 Sep 01 16:35:55.020277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-8c1744a3-b7f8-41e4-a019-b2cf762b8ce7 req-ce9019ff-7351-428d-8e1d-986626709d1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034901 Sep 01 16:35:55.020895 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 226/464] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:55.509087 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:55.510071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:55.518491 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.519297 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.520497 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.521804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.522486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.523017 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.677987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:55.686441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-07f7d378-ea0b-44a0-9240-349dd331039e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.181927 Sep 01 16:35:55.687024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 239/465] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:55 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:55.851338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:55.852112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:55.859084 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.859604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.860035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.860779 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.861225 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.861972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:56.102833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:56.112824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cbea0669-5507-4a79-a12f-932117dddfc2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.266187 Sep 01 16:35:56.115850 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 227/466] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:55 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:56.708102 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:56.708713 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:56.716059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:56.716884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:56.717391 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:56.718487 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:56.718945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:56.719571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:56.941963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:56.950618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4f5f61e3-38d9-4eb1-be1d-d28b1e2d0b5a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.246498 Sep 01 16:35:56.951211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 240/467] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:56 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:57.140471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:57.141165 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:57.147649 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:57.148137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:57.148569 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:57.149261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:57.149704 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:57.150113 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:57.300284 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:57.308406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5bd80981-3a82-4e69-90aa-a0d6db5997f2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.172666 Sep 01 16:35:57.308863 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 228/468] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:57 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:57.846672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-ffc46337-9077-4ca2-b5f8-ec9d07445262 req-54eae1fc-531a-43d8-aa02-1f81c4cffebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6a9ac9-616c-4e7b-a0f8-f37ba164254a", "tag": "aa0e65b8-6c29-4bc7-a8bb-dd92861f558c"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:57.857563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ffc46337-9077-4ca2-b5f8-ec9d07445262 req-54eae1fc-531a-43d8-aa02-1f81c4cffebc service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:57.858412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ffc46337-9077-4ca2-b5f8-ec9d07445262 req-54eae1fc-531a-43d8-aa02-1f81c4cffebc service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:57.859107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ffc46337-9077-4ca2-b5f8-ec9d07445262 req-54eae1fc-531a-43d8-aa02-1f81c4cffebc service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:57.881052 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-ffc46337-9077-4ca2-b5f8-ec9d07445262 req-54eae1fc-531a-43d8-aa02-1f81c4cffebc service nova] Creating event network-changed:aa0e65b8-6c29-4bc7-a8bb-dd92861f558c for instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a on hv-cinder-83602 Sep 01 16:35:57.886352 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-ffc46337-9077-4ca2-b5f8-ec9d07445262 req-54eae1fc-531a-43d8-aa02-1f81c4cffebc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043845 Sep 01 16:35:57.887475 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 241/469] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:57.973144 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:57.973897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:57.981175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:57.982102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:57.982910 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:57.984044 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:57.984510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:57.984945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:58.149598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:58.158419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8d3381b4-d227-436b-b6cf-6c29a3c3b2f2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1319 microversion: 2.1 time: 0.189763 Sep 01 16:35:58.159371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 229/470] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:57 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:58.343193 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:58.343833 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:58.352008 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:58.352886 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:58.353660 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:58.354877 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:58.355478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:58.356437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:58.638863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:58.652550 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ca5a9b32-dcbd-4717-be54-3e0e34bb65b2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.322392 Sep 01 16:35:58.670659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 242/471] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:58 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:59.183545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:59.183545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:59.192352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:59.192846 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:59.193524 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:59.194541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:59.194990 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:59.195656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:59.372401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:59.380905 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ade5bda8-f883-432d-905b-d7daa38b9fcf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1508 microversion: 2.1 time: 0.205135 Sep 01 16:35:59.381496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 230/472] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:59 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:59.678687 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:59.679554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:59.685826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:59.687678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:59.687678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:59.687678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:59.688086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:59.688756 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:59.710436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:00.228938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:00.275328 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4c2bbe5c-e39e-4fab-b9e7-71c172e48f8d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.601482 Sep 01 16:36:00.287238 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 243/473] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:59 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:01.313023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:01.313023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:01.313023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:01.313023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=10 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:01.315357 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:01.316057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:01.316675 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:01.317553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:01.318169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:01.319012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:01.493069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:01.501667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-76c553be-f3de-42d2-bdb2-d2b2dfa635d5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.208983 Sep 01 16:36:01.502255 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 231/474] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:01 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:02.523449 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:02.524227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:02.540402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:02.542632 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:02.543989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:02.545499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:02.546202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:02.546844 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:02.578664 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=14 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:02.825443 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:02.839245 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e2bf53ae-5682-48a2-b0fe-d61fd11e7c5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.319499 Sep 01 16:36:02.840223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 244/475] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:02 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:03.863896 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:03.864459 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:03.874234 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:03.879101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:03.879101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:03.879101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:03.879101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:03.879562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:04.030282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:04.038909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e15728e8-ed89-4e30-bfb2-0a94185970ed tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.179935 Sep 01 16:36:04.051270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 232/476] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:03 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:05.063243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:05.064271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:05.076983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:05.078071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:05.078555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:05.081536 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:05.082004 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:05.083250 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:05.288242 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:05.297130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-37e1a286-1396-4629-953e-302920e93c6f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.239686 Sep 01 16:36:05.297812 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 245/477] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:05 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:06.321842 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:06.322777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:06.331611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:06.332545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:06.333197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:06.334124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:06.334680 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:06.335178 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:06.341519 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:06.539248 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:06.554007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1aa2d346-d352-4d39-8aa7-bb20a5178ca0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.237324 Sep 01 16:36:06.560027 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 233/478] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:06 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:07.580460 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:07.581079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:07.583080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:07.597075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:07.597566 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:07.597996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:07.598699 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:07.599174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:07.599608 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:07.800228 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:07.810106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dede0533-04d6-4ec0-ae6e-e57f67c72d0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.233168 Sep 01 16:36:07.820622 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 246/479] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:07 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:08.834545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:08.835958 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:08.845368 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:08.846188 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:08.846826 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:08.847612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:08.848275 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:08.848886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:09.027459 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:09.040146 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-485c0946-c4fb-422a-9633-a7ed9fde0c8a tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.210648 Sep 01 16:36:09.041035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 234/480] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:08 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:10.070025 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:10.070644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:10.078236 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:10.078729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:10.079178 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:10.079877 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:10.080327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:10.080739 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:10.259341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:10.267582 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f08eca44-0475-4cd3-8c14-aff491dbddd1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.208709 Sep 01 16:36:10.268379 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 247/481] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:10 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:11.289387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:11.290263 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:11.295359 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:11.299772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-db765a6a-b565-4baf-9f84-3f902b9808d6 req-f617adf0-421d-4d8e-8003-9d2f69b4837d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6a9ac9-616c-4e7b-a0f8-f37ba164254a", "name": "network-vif-plugged", "status": "completed", "tag": "aa0e65b8-6c29-4bc7-a8bb-dd92861f558c"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:11.306576 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:11.307818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:11.309166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.315107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-db765a6a-b565-4baf-9f84-3f902b9808d6 req-f617adf0-421d-4d8e-8003-9d2f69b4837d service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:11.316356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:11.317122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:11.318108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.322506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-db765a6a-b565-4baf-9f84-3f902b9808d6 req-f617adf0-421d-4d8e-8003-9d2f69b4837d service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:11.322954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-db765a6a-b565-4baf-9f84-3f902b9808d6 req-f617adf0-421d-4d8e-8003-9d2f69b4837d service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.341913 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-db765a6a-b565-4baf-9f84-3f902b9808d6 req-f617adf0-421d-4d8e-8003-9d2f69b4837d service nova] Creating event network-vif-plugged:aa0e65b8-6c29-4bc7-a8bb-dd92861f558c for instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a on hv-cinder-83602 Sep 01 16:36:11.357119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-db765a6a-b565-4baf-9f84-3f902b9808d6 req-f617adf0-421d-4d8e-8003-9d2f69b4837d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060314 Sep 01 16:36:11.358336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 248/482] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:11.670532 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:11.681375 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c7fd45c5-ac3a-429d-b4eb-2fb6949f1297 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.395767 Sep 01 16:36:11.695095 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 235/483] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:11 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:12.704408 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.705141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:12.711875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.712383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.712792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.713554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.713923 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.714338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.934195 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:12.947781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cac2c76c-e2a1-45d6-83bb-1a93c204f5ea tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.248273 Sep 01 16:36:12.948703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 249/484] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:13.970010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:13.971421 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:13.979765 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.980591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.981306 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:13.982819 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.983571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.984142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:14.170543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:14.195290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0c76c1ec-c84e-4b0a-901c-4680ed4c1ef3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1371 microversion: 2.1 time: 0.229395 Sep 01 16:36:14.196284 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 236/485] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:13 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:15.227288 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:15.228671 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:15.236586 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.237080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.237513 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.238212 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.238662 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.239081 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.526486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:15.539517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-562fe341-a70d-411c-bf27-de3231a0a530 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1566 microversion: 2.1 time: 0.316992 Sep 01 16:36:15.556015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 250/486] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:15 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1566 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:15.570396 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-83d45ca9-3546-49e1-92e8-b83c93ca5d21 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:15.571448 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-83d45ca9-3546-49e1-92e8-b83c93ca5d21 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:15.579908 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-83d45ca9-3546-49e1-92e8-b83c93ca5d21 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.580808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-83d45ca9-3546-49e1-92e8-b83c93ca5d21 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.581441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-83d45ca9-3546-49e1-92e8-b83c93ca5d21 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.582565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-83d45ca9-3546-49e1-92e8-b83c93ca5d21 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.584949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-83d45ca9-3546-49e1-92e8-b83c93ca5d21 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.586569 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-83d45ca9-3546-49e1-92e8-b83c93ca5d21 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.703876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-83d45ca9-3546-49e1-92e8-b83c93ca5d21 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138118 Sep 01 16:36:15.705223 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 237/487] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 16:36:15 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:17.315841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-6897a2b2-7bb9-4730-a549-5e7ab1d27b90 req-322dabe0-0082-4b98-a15a-35794a2d131e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6a9ac9-616c-4e7b-a0f8-f37ba164254a", "tag": "aa0e65b8-6c29-4bc7-a8bb-dd92861f558c"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:17.333845 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-6897a2b2-7bb9-4730-a549-5e7ab1d27b90 req-322dabe0-0082-4b98-a15a-35794a2d131e service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:17.334658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-6897a2b2-7bb9-4730-a549-5e7ab1d27b90 req-322dabe0-0082-4b98-a15a-35794a2d131e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:17.335620 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-6897a2b2-7bb9-4730-a549-5e7ab1d27b90 req-322dabe0-0082-4b98-a15a-35794a2d131e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:17.351048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-6897a2b2-7bb9-4730-a549-5e7ab1d27b90 req-322dabe0-0082-4b98-a15a-35794a2d131e service nova] Creating event network-changed:aa0e65b8-6c29-4bc7-a8bb-dd92861f558c for instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a on hv-cinder-83602 Sep 01 16:36:17.356840 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-6897a2b2-7bb9-4730-a549-5e7ab1d27b90 req-322dabe0-0082-4b98-a15a-35794a2d131e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048226 Sep 01 16:36:17.359765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 251/488] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:25.354092 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c35bef7c-664a-472f-bc35-ac785e24a006 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Action: 'create', calling method: .version_select at 0x7fe37a1824c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1855903187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQ21jvACIoqWoBPVYRrQl/E9Y2Yr25hlLvVyfRzrHbUtzqD5VwkE4RreM3y1TWs7jZXmZxIeqGLEgs5hh7E4bTefGS5V/WlWImo/fwXqvhnY5AIdbAbmEKFbuBcHHsrvA=="}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:25.372772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-c35bef7c-664a-472f-bc35-ac785e24a006 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Getting quotas for project 9193c40d930d4774b800ddfeefbf8c92. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:25.377270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-c35bef7c-664a-472f-bc35-ac785e24a006 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Getting quotas for user cf9862b97ba64cc09b4903ba24ac2181 and project 9193c40d930d4774b800ddfeefbf8c92. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:25.518295 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c35bef7c-664a-472f-bc35-ac785e24a006 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.168668 Sep 01 16:36:25.518849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 238/489] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:36:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:25.573263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-737557751", "imageRef": "b1537e35-5c1b-426e-8e21-025e54bfcaf0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1855903187", "networks": [{"uuid": "273ccfc4-ee06-4897-b2c3-560c68ef05f5"}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:25.626751 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] validate_networks() for [('273ccfc4-ee06-4897-b2c3-560c68ef05f5', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:36:26.022704 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:36:26.023120 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:36:26.023606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:36:26.024002 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:36:26.024407 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:36:26.033681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.034147 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.034575 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.035530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:26.035873 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:26.036284 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:26.055167 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Getting quotas for project 9193c40d930d4774b800ddfeefbf8c92. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:36:26.061796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Getting quotas for user cf9862b97ba64cc09b4903ba24ac2181 and project 9193c40d930d4774b800ddfeefbf8c92. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:36:26.071473 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:36:26.073699 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1537e35-5c1b-426e-8e21-025e54bfcaf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:36:26.247859 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8406f728-4745-41ce-972f-a275a6e9f4f2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679018 Sep 01 16:36:26.251721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 252/490] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:36:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:36:26.260237 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3500cdc9-dcb0-4fcc-b425-55f179f1e275 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:26.260869 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3500cdc9-dcb0-4fcc-b425-55f179f1e275 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:26.268198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=26 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:26.334760 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3500cdc9-dcb0-4fcc-b425-55f179f1e275 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:26.344594 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3500cdc9-dcb0-4fcc-b425-55f179f1e275 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1258 microversion: 2.1 time: 0.086646 Sep 01 16:36:26.345894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 239/491] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:26 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:27.366670 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-13c408e8-af4a-489c-bbd1-e7dc11639682 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:27.367324 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-13c408e8-af4a-489c-bbd1-e7dc11639682 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:27.422342 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-13c408e8-af4a-489c-bbd1-e7dc11639682 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:27.433991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-13c408e8-af4a-489c-bbd1-e7dc11639682 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1258 microversion: 2.1 time: 0.070884 Sep 01 16:36:27.434447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 253/492] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:27 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:28.455295 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:28.455850 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:28.463483 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.466558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.466558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.466558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:28.466558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:28.466955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:28.531842 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:28.540610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9efb0fd1-b004-4857-a789-81f79e7d8c1b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1254 microversion: 2.1 time: 0.089672 Sep 01 16:36:28.543743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 240/493] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:28 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1254 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:29.561333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:29.561950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:29.565808 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:36:29.565958 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Thu Sep 1 16:36:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 (ip 10.222.0.16) !!! Sep 01 16:36:29.572776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.573233 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.573657 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:29.574382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:29.574831 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:29.575283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:29.648620 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:29.656577 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f87efc08-b411-4d71-b9fc-151264f2c4ff tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1310 microversion: 2.1 time: 0.099083 Sep 01 16:36:29.657148 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 254/494] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:29 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:30.680593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:30.680593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:30.687220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:30.688185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:30.690520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:30.693316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:30.694163 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:30.695112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:30.875327 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:30.889289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f7b8a29e-5c2b-4b3c-b33e-330e464aaedf tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.216107 Sep 01 16:36:30.890798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 241/495] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:30 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:31.592194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d128a7a7-6a5e-4b2a-afb7-664d3b1da66f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b26703f-24f6-4775-a1f5-3d154e1cbf86", "device": "/dev/sdb"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:31.595921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d128a7a7-6a5e-4b2a-afb7-664d3b1da66f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:31.602141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d128a7a7-6a5e-4b2a-afb7-664d3b1da66f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.602618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d128a7a7-6a5e-4b2a-afb7-664d3b1da66f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.603049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d128a7a7-6a5e-4b2a-afb7-664d3b1da66f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.603780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d128a7a7-6a5e-4b2a-afb7-664d3b1da66f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.604226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d128a7a7-6a5e-4b2a-afb7-664d3b1da66f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.604648 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d128a7a7-6a5e-4b2a-afb7-664d3b1da66f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.918734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:31.919512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:31.930015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.930517 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.930955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:31.931737 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:31.932241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:31.932665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:32.081611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:32.089810 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-443dc1f6-6907-4be6-a7d0-2c84ee2a5f02 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.174982 Sep 01 16:36:32.090405 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 242/496] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:31 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:33.111755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:33.112391 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:33.118818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.119339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.119789 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.120473 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:33.120924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:33.121343 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:33.279393 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:33.288343 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1ec6b46e-80ca-4962-9fae-eadd6b45dd4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.181559 Sep 01 16:36:33.294981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 243/497] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:33 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:34.310350 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:34.311589 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:34.318775 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:34.319359 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:34.319786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:34.320750 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:34.321192 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:34.321605 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:34.484162 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:34.492841 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4eec25fc-188c-4499-8f65-e4efff2b2101 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.186293 Sep 01 16:36:34.493435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 244/498] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:34 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:35.515235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:35.515986 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:35.523368 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.523857 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.524286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.524986 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:35.525434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:35.525854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:35.718295 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:35.729521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ffbc1aa0-468e-4259-960d-cb155c80cea7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.218482 Sep 01 16:36:35.730480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 245/499] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:35 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:36.044078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:36.749892 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:36.750815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:36.752963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=6 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:36.758355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.758835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.759299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.760001 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:36.760456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:36.760871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:36.912870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:36.921126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4e9e610b-1546-4125-9d25-523b5a9b84d4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.175019 Sep 01 16:36:36.921708 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 246/500] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:36 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:37.430888 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=8 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:37.944320 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:37.944916 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:37.952179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.952675 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.953105 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:37.953808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:37.954257 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:37.955428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:38.106134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:38.119072 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ad9a3e0c-92a7-4af1-9b05-a701f7de1265 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.179618 Sep 01 16:36:38.120028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 247/501] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:37 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:39.147201 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:39.148384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:39.154454 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.159240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.159240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.159240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:39.159240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:39.165696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:39.310700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:39.318906 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c7b6c2e3-9b33-48b9-9c94-d007105837ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.176664 Sep 01 16:36:39.319531 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 248/502] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:39 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:40.344075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:40.345021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:40.355174 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.356026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.356657 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.357579 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:40.358248 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:40.358861 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:40.502914 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:40.511880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2f8575d2-4be5-47be-93cd-cd50118e635e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.173513 Sep 01 16:36:40.512559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 249/503] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:40 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:41.534479 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:41.535310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:41.542012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.542499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.542959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.543709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:41.544161 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:41.544586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:41.599802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:41.696477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=56 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:41.697545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:41.707798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-da8cd55d-d5df-4948-b991-4330e6cef44f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.177431 Sep 01 16:36:41.709140 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 250/504] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:41 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:42.730453 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:42.731106 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:42.738530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.739346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.739782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.740494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:42.740943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:42.741361 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:42.888688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:42.900538 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f0bd4cca-0606-4936-9c7d-2c95faf7d20d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.174162 Sep 01 16:36:42.901139 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 251/505] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:42 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:43.922174 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:43.922924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:43.930312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.930905 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.931604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:43.934103 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:43.934625 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:43.935092 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:44.085853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:44.093952 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-478f4f98-f54a-4fd5-b60b-15e8309f07d6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.175745 Sep 01 16:36:44.094550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 252/506] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:43 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:45.116496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:45.117135 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:45.119386 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:45.124023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.124494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.124925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.125608 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:45.126053 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:45.126520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:45.263806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:45.272531 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-91204fcb-571b-4f78-ac44-9b0b4e6edcc1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.160008 Sep 01 16:36:45.273113 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 253/507] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:45 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:46.293876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:46.294533 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:46.301496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.301972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.302429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.303123 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:46.303595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:46.304012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:46.435816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:46.443670 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e5365260-26a8-4c07-bf67-c746e90c4d89 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.153533 Sep 01 16:36:46.444260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 254/508] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:46 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:47.463991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:47.464723 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:47.472085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.472586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.473027 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.473732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:47.474185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:47.474604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:47.608838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:47.617546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f51146c1-24e3-41d3-9ad0-251bdeaac8ba tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.157310 Sep 01 16:36:47.620833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 255/509] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:47 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:48.638763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:48.639513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:48.646057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.646564 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.647001 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.647725 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:48.648172 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:48.648590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:48.667393 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:48.796420 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:48.804605 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2e5d3f01-e89c-4283-a7b6-4af16688115e tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.169751 Sep 01 16:36:48.805199 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 256/510] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:48 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:49.826246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:49.826933 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:49.834167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:49.834639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:49.835070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:49.835800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:49.836253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:49.836682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:49.966873 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:49.976390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9fced578-8207-4c6d-b171-98125cebda7a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.154048 Sep 01 16:36:49.976975 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 257/511] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:49 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:50.997807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:50.998508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:51.006407 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:51.006900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:51.007365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:51.008069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:51.008512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:51.008933 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:51.149158 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:51.156903 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-28d9e615-2f14-4d54-888e-5e29be38ad56 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.163014 Sep 01 16:36:51.157482 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 258/512] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:50 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:52.132645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-3767dcf7-d35e-4b9a-bdf9-747e45e5dda2 req-98a91caa-5f11-42fc-813d-b9d7003e8cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63da505-aaed-4f08-a8f8-a3dc1a11cf27", "tag": "9f8b31c0-0f62-4b60-8cd2-e60302efe717"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:52.143249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-3767dcf7-d35e-4b9a-bdf9-747e45e5dda2 req-98a91caa-5f11-42fc-813d-b9d7003e8cd9 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.144141 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-3767dcf7-d35e-4b9a-bdf9-747e45e5dda2 req-98a91caa-5f11-42fc-813d-b9d7003e8cd9 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.144625 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-3767dcf7-d35e-4b9a-bdf9-747e45e5dda2 req-98a91caa-5f11-42fc-813d-b9d7003e8cd9 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.156169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-3767dcf7-d35e-4b9a-bdf9-747e45e5dda2 req-98a91caa-5f11-42fc-813d-b9d7003e8cd9 service nova] Creating event network-changed:9f8b31c0-0f62-4b60-8cd2-e60302efe717 for instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 on hv-cinder-83602 Sep 01 16:36:52.162321 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-3767dcf7-d35e-4b9a-bdf9-747e45e5dda2 req-98a91caa-5f11-42fc-813d-b9d7003e8cd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033560 Sep 01 16:36:52.163041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 259/513] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:52.179123 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:52.190323 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:52.190323 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.190323 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.190323 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.190991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:52.190991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:52.190991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:52.215983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d128a7a7-6a5e-4b2a-afb7-664d3b1da66f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "POST /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 20.627940 Sep 01 16:36:52.220977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 255/514] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:36:31 2022] POST /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6/os-volume_attachments => generated 194 bytes in 20634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:52.342047 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:52.350073 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c2ddc546-984e-4cce-aa36-afcb0e3c7f08 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.175079 Sep 01 16:36:52.350734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 260/515] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:52 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:53.386119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:53.386119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:53.390439 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.390635 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.390996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.391728 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:53.392777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:53.393508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:53.618794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:53.627377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-342247e8-ac17-4d40-8198-f7a5c3ff3c59 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.254141 Sep 01 16:36:53.628188 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 256/516] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:53 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:54.648393 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:54.649024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:54.655469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.655944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.656368 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.657048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:54.657486 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:54.658553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:54.792086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:54.801111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-155efdd2-1f72-4605-9340-6943c84292c7 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.156465 Sep 01 16:36:54.801704 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 261/517] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:54 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:55.822437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:55.822984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:55.830064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:55.830478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:55.830914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:55.831652 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:55.832103 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:55.832522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:55.969971 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:55.979008 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7c623d68-b36a-4d5a-b864-05dfd4761b63 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.160848 Sep 01 16:36:55.980221 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 257/518] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:55 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:57.000598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:57.003687 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:57.009471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.009967 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.010402 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.011114 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.011874 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.012603 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.171854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:57.181810 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0228ebc4-f296-4ad0-86c7-179a71a6d73a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.184979 Sep 01 16:36:57.182484 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 262/519] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:56 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:58.204368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:58.205831 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:58.212954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.213435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.213850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.214539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.214977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.215556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.351960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:58.359858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b1353576-dd21-4f09-9cdb-d55068087a39 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.159383 Sep 01 16:36:58.360431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 258/520] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:58 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:59.384711 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:59.385721 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:59.392437 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.392982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.393433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.394145 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.394602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.395032 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.546900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.555458 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-580773c4-6f7c-4edd-9a62-0e327b49862a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.177583 Sep 01 16:36:59.562110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 263/521] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:59 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:59.808786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-03fd5afe-8109-4abb-bcc4-0989034bfd72 req-dd02a265-d484-4b65-9173-573c81b9f6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63da505-aaed-4f08-a8f8-a3dc1a11cf27", "name": "network-vif-plugged", "status": "completed", "tag": "9f8b31c0-0f62-4b60-8cd2-e60302efe717"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:59.816529 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-03fd5afe-8109-4abb-bcc4-0989034bfd72 req-dd02a265-d484-4b65-9173-573c81b9f6b9 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.817160 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-03fd5afe-8109-4abb-bcc4-0989034bfd72 req-dd02a265-d484-4b65-9173-573c81b9f6b9 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.817932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-03fd5afe-8109-4abb-bcc4-0989034bfd72 req-dd02a265-d484-4b65-9173-573c81b9f6b9 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.834917 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-03fd5afe-8109-4abb-bcc4-0989034bfd72 req-dd02a265-d484-4b65-9173-573c81b9f6b9 service nova] Creating event network-vif-plugged:9f8b31c0-0f62-4b60-8cd2-e60302efe717 for instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 on hv-cinder-83602 Sep 01 16:36:59.842100 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-03fd5afe-8109-4abb-bcc4-0989034bfd72 req-dd02a265-d484-4b65-9173-573c81b9f6b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042906 Sep 01 16:36:59.843261 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 259/522] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:00.584736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:00.585508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:00.593064 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.593543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.594513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.595294 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.596452 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.596899 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.764216 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:00.774804 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3a92924c-543e-47ec-a163-212912b5105b tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.197883 Sep 01 16:37:00.775442 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 264/523] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:00 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:01.797789 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:01.799656 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:01.806805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.807435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.807956 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.808986 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.809524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.810038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.963798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:01.972531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6f26d672-b744-4f23-989f-5afae9d6784d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.180177 Sep 01 16:37:01.973026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 260/524] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:01 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:03.005776 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.006420 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.013241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.013723 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.014157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.014849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.015443 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.020037 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.181822 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:03.190379 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a4659df7-7635-44fe-9b64-4a53af032714 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.188317 Sep 01 16:37:03.191102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 265/525] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:03 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:04.212354 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.213162 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.220007 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.221300 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.221731 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.222420 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.222860 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.223298 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.359568 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.367778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9fa3a525-4688-49bf-9818-892d4fdcff62 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.159310 Sep 01 16:37:04.368379 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 261/526] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:04 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:05.389201 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.389856 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.396575 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.397056 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.397487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.398179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.398637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.399043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.549104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.557488 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-353c7684-5d3b-46e5-a487-cf4009c31de6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.172191 Sep 01 16:37:05.558066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 266/527] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:05.985108 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4f4d2bce-1296-4249-98e4-ba012bbceb22 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.985629 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4f4d2bce-1296-4249-98e4-ba012bbceb22 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.992902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f4d2bce-1296-4249-98e4-ba012bbceb22 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.996701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f4d2bce-1296-4249-98e4-ba012bbceb22 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.996701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f4d2bce-1296-4249-98e4-ba012bbceb22 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.996701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f4d2bce-1296-4249-98e4-ba012bbceb22 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.996701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f4d2bce-1296-4249-98e4-ba012bbceb22 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.997154 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f4d2bce-1296-4249-98e4-ba012bbceb22 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.019662 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4f4d2bce-1296-4249-98e4-ba012bbceb22 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/ips" status: 200 len: 150 microversion: 2.20 time: 0.038452 Sep 01 16:37:06.020230 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 262/528] 10.222.0.16 () {60 vars in 1289 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:37:06.579109 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:06.580662 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.586977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.587497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.587931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.588627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.589082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.589500 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.745755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.757315 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b2110e74-cb0a-406f-aba4-5f3bbe3ce20c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.181958 Sep 01 16:37:06.757917 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 267/529] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:06 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:07.688810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-107340a2-a88b-4912-95b6-a49ba8657ffe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.689523 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-107340a2-a88b-4912-95b6-a49ba8657ffe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.697451 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-107340a2-a88b-4912-95b6-a49ba8657ffe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.697941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-107340a2-a88b-4912-95b6-a49ba8657ffe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.698372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-107340a2-a88b-4912-95b6-a49ba8657ffe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.699073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-107340a2-a88b-4912-95b6-a49ba8657ffe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.699572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-107340a2-a88b-4912-95b6-a49ba8657ffe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.699992 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-107340a2-a88b-4912-95b6-a49ba8657ffe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.725210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-107340a2-a88b-4912-95b6-a49ba8657ffe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/ips" status: 200 len: 150 microversion: 2.1 time: 0.040193 Sep 01 16:37:07.725813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 263/530] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:07.786295 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.787130 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.805219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.805219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.805219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.805219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.805909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.805909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.968494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:07.978341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ea47c673-7b61-4654-8831-714358f8f2a1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1358 microversion: 2.1 time: 0.200996 Sep 01 16:37:07.979934 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 268/531] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:09.006765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.007437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.014140 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.014589 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.015009 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.015731 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.016186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.016595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.155263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.168238 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-01c35223-7f64-4f3c-b7e0-3da042900c29 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1548 microversion: 2.1 time: 0.166215 Sep 01 16:37:09.168832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 264/532] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:09.197382 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.198323 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.210187 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.210951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.211811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.213333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.213898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.214592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.366246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.374203 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ba6ce6c0-6e8c-48ed-8448-a85d8a7bdcb2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1548 microversion: 2.1 time: 0.187579 Sep 01 16:37:09.374798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 269/533] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:09.395434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.401901 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.403307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Searching by: {'deleted': False, 'project_id': '9193c40d930d4774b800ddfeefbf8c92'} {{(pid=127531) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 16:37:09.416238 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.417096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.417864 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.419136 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.419970 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.420746 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.536312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.multi_cell_list [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127531) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 16:37:09.637012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e65765e3-b350-4354-b25c-c146aee7bcd6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.246110 Sep 01 16:37:09.637319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 265/534] 10.222.0.16 () {58 vars in 1125 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers => generated 342 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:09.649376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.649984 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.656226 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.656611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.657254 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.658957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.659339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.659778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.799066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:09.807057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1e352fd8-aa51-4670-b884-e07147dbef87 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1548 microversion: 2.1 time: 0.161534 Sep 01 16:37:09.807668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 270/535] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:10.282191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:10.282770 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.289953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.293091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.293091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.293091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.293091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.293437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.316307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lazy-loading 'flavor' on Instance uuid aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:10.882407 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb58d3e7-699a-42e9-82bb-18b88dada358 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/action" status: 202 len: 0 microversion: 2.20 time: 0.604161 Sep 01 16:37:10.883116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 266/536] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 1 16:37:10 2022] POST /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:37:10.891867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:10.893499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.900725 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.901213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.901648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.902350 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.902806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.903282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.046685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.051993 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.053428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.054638 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9aa4a6e6-d6ab-45e0-85b5-70848bd269f8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.166873 Sep 01 16:37:11.055285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 271/537] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:10 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:11.500615 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5914e474-f2b2-4bce-bddf-55c03f798b95 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:11.501196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5914e474-f2b2-4bce-bddf-55c03f798b95 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:11.508947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5914e474-f2b2-4bce-bddf-55c03f798b95 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.510996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5914e474-f2b2-4bce-bddf-55c03f798b95 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.510996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5914e474-f2b2-4bce-bddf-55c03f798b95 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.510996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5914e474-f2b2-4bce-bddf-55c03f798b95 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.510996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5914e474-f2b2-4bce-bddf-55c03f798b95 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.511401 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5914e474-f2b2-4bce-bddf-55c03f798b95 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.537618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5914e474-f2b2-4bce-bddf-55c03f798b95 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/ips" status: 200 len: 145 microversion: 2.1 time: 0.042255 Sep 01 16:37:11.538207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 267/538] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:37:11 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:12.080220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:12.080824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:12.088682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.088986 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.089420 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.090212 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.090661 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.091081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.241219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:12.250087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:12.251785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:12.253360 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1a5c89a7-f400-4742-9fee-3b76fd1618c1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.177128 Sep 01 16:37:12.254083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 272/539] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:12 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:13.278240 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:13.278842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:13.286552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.287045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.289489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.289489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.289489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.289489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.292191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:13.434278 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.442900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.444442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.445682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-92572a8d-fdd7-4bb7-aa5e-28f652f28b10 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.171498 Sep 01 16:37:13.446252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 268/540] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:13 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:14.472848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:14.472848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:14.478889 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.479402 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.479830 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.480771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.480958 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.481378 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.631484 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.635250 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:14.640571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.642033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.643298 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b2cd4c27-8067-40ae-9e59-a78bd09d71e7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.177557 Sep 01 16:37:14.643880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 273/541] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:14 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:15.666513 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:15.667106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:15.675130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:15.675659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:15.676082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:15.676777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:15.677219 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:15.677639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:15.816109 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:15.824749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:15.826214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:15.827397 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d00f422c-84ea-4b45-b1ae-154c52c297d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.164801 Sep 01 16:37:15.827947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 269/542] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:15 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:16.851182 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:16.851955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:16.855552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=42 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:16.860395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:16.860888 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:16.861900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:16.862612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:16.863060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:16.863503 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.009949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.018541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.020015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.021242 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-223be55b-ca50-4fd7-8617-f0f50ed6939d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.174060 Sep 01 16:37:17.021824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 274/543] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:16 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:18.045092 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:18.045696 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:18.052552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.053051 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.053490 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.054188 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.054675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.055096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.198556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:18.210508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:18.212007 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:18.213249 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-05813792-35c1-42d7-8e34-49595d68ac9c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.172156 Sep 01 16:37:18.213812 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 270/544] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:18 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:19.236102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:19.236712 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:19.244845 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:19.244946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.245387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.246096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:19.246547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.247003 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.391951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:19.401253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:19.402706 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:19.403913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9a442026-4bdd-4c2a-8e82-8a9e5ed03805 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.171706 Sep 01 16:37:19.404486 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 275/545] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:19 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:20.432185 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:20.432185 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:20.432185 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:20.435958 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.436705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.437144 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.437847 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.438298 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.438719 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.585123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.594016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.596090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.598371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3857041e-7ad2-4edd-8646-39d01105cbcf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.175786 Sep 01 16:37:20.598919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 271/546] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:20 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:21.325929 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7c60fe32-7550-4a23-b2ef-0db8785aee39 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "965beab6-f9ca-4325-bd18-cddec1db5633"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:21.328503 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7c60fe32-7550-4a23-b2ef-0db8785aee39 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:21.339073 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c60fe32-7550-4a23-b2ef-0db8785aee39 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.339852 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c60fe32-7550-4a23-b2ef-0db8785aee39 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.340483 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c60fe32-7550-4a23-b2ef-0db8785aee39 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.341561 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c60fe32-7550-4a23-b2ef-0db8785aee39 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.342213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c60fe32-7550-4a23-b2ef-0db8785aee39 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.342831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c60fe32-7550-4a23-b2ef-0db8785aee39 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.621966 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:21.622557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:21.629931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.630414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.630848 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.631577 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.632033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.632456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.791797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:21.801373 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:21.802795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:21.803983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da975904-5017-4fc8-82bd-8b2ede92a7ae tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.185894 Sep 01 16:37:21.804539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 272/547] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:21 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:22.826809 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:22.827934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:22.829781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=35 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:22.835518 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.836001 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.836437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.837137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.837580 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.837995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.973514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:22.982127 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:22.983603 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:22.984834 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-47869f83-7ee9-4cd9-8916-7ab1d4df9136 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.162616 Sep 01 16:37:22.985400 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 273/548] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:22 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:24.008432 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:24.009075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:24.015448 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.015958 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.016392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.017081 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.018053 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.018477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.154184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:24.163348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:24.164818 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:24.165930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-959ca828-6e91-4efa-afa0-bf6d119aed66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.161438 Sep 01 16:37:24.166507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 274/549] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:24 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:25.189784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:25.190604 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:25.197045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.197775 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.198226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.198907 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.199373 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.199785 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.350504 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:25.359479 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:25.360983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:25.363070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3e5b2173-bc63-4164-90be-24d5d1a38bd7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.177800 Sep 01 16:37:25.363673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 275/550] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:25 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:25.746325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7c60fe32-7550-4a23-b2ef-0db8785aee39 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.424119 Sep 01 16:37:25.747342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 276/551] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:37:21 2022] POST /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments => generated 194 bytes in 4426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:26.399673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:26.400348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:26.407087 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.407616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.408123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.408953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.409497 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.409930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.578571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.589941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.591444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.592780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-57e5be11-a7cc-4508-b327-c348bb150bac tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.197175 Sep 01 16:37:26.593287 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 276/552] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:26 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:26.907851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bd28f38c-0e62-471c-93d8-44304327d4cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "065b88db-58d2-4b08-bae1-96dd1282ce30"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:26.909455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bd28f38c-0e62-471c-93d8-44304327d4cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:26.920290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bd28f38c-0e62-471c-93d8-44304327d4cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.920774 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bd28f38c-0e62-471c-93d8-44304327d4cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.921312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bd28f38c-0e62-471c-93d8-44304327d4cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.922025 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bd28f38c-0e62-471c-93d8-44304327d4cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.922470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bd28f38c-0e62-471c-93d8-44304327d4cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.922893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bd28f38c-0e62-471c-93d8-44304327d4cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.619249 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:27.620231 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:27.628347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.628832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.629261 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.629958 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.630404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.630821 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.795844 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.804800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.806280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.807467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b5ebe0fc-3372-41cc-b58b-113ed86662b4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.193286 Sep 01 16:37:27.808029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 277/553] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:27 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:27.909397 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fddc7f0d-982a-4ad4-a8e1-b7ba2389b5ad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "507a45dc-42ae-4828-bf65-4e43a8501dbf"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:27.912120 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fddc7f0d-982a-4ad4-a8e1-b7ba2389b5ad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:27.918281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fddc7f0d-982a-4ad4-a8e1-b7ba2389b5ad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.918727 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fddc7f0d-982a-4ad4-a8e1-b7ba2389b5ad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.919174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fddc7f0d-982a-4ad4-a8e1-b7ba2389b5ad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.919889 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fddc7f0d-982a-4ad4-a8e1-b7ba2389b5ad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.920339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fddc7f0d-982a-4ad4-a8e1-b7ba2389b5ad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.920785 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fddc7f0d-982a-4ad4-a8e1-b7ba2389b5ad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.999890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bd28f38c-0e62-471c-93d8-44304327d4cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "POST /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.101245 Sep 01 16:37:28.001395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 277/554] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:37:26 2022] POST /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments => generated 194 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:28.833195 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:28.833925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:28.840309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.840795 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.841227 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:28.841995 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.842450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.842871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.008068 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.016743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.019388 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.020696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2887f99b-219c-4386-a250-18c3d6a15ff7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.192979 Sep 01 16:37:29.021267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 278/555] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:28 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:29.038703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fddc7f0d-982a-4ad4-a8e1-b7ba2389b5ad tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.133669 Sep 01 16:37:29.042755 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 278/556] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:37:27 2022] POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:30.046454 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:30.047186 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:30.054804 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.055339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.055953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.056663 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.057109 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.057531 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.280142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.288518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.289815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.290986 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5b2fecb2-c6fb-4481-8052-129d42db86a4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.248520 Sep 01 16:37:30.291587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 279/557] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:30 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:31.315961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:31.316765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:31.323670 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.324184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.324619 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.325307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.325760 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.326181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.446697 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:31.448139 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:31.454816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.456021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.456383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.457294 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.457745 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.458170 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.460883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:31.469374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:31.471561 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:31.472853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e634df5a-b67a-4419-a4ce-dcf5749ada6e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.161810 Sep 01 16:37:31.473474 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 279/558] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:31 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:31.589883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lazy-loading 'services' on Instance uuid 31c1f79f-e737-474c-baa4-da016497a1c6 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:31.866952 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-72c4bc65-26a7-4e8e-84f9-f08872d0b2d6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6/os-volume_attachments/7b26703f-24f6-4775-a1f5-3d154e1cbf86" status: 202 len: 0 microversion: 2.1 time: 0.424155 Sep 01 16:37:31.867592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 280/559] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:37:31 2022] DELETE /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6/os-volume_attachments/7b26703f-24f6-4775-a1f5-3d154e1cbf86 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:37:32.495865 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:32.496499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:32.503537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.504016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.504443 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.505124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.505568 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.505987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.655414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:32.664372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:32.665808 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:32.666947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8edcf94a-4b2e-43fb-a620-dd704bab56fd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.175036 Sep 01 16:37:32.667557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 280/560] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:32 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:33.691502 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:33.692223 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:33.698815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:33.699327 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:33.699759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:33.700450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:33.700894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:33.701311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:33.858268 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:33.858268 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:33.858549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:33.858549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0fd3c403-5afe-4bc0-961a-dab4bd42a819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.170750 Sep 01 16:37:33.858549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 281/561] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:33 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:34.882495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:34.883538 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:34.890773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:34.891410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:34.891843 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:34.893207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:34.893672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:34.894089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:35.029308 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.037918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.039400 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.040537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3b3aa81a-7c77-4371-81b1-40c8b81c846a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.162433 Sep 01 16:37:35.041087 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 281/562] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:34 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:36.064187 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:36.065000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:36.071442 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:36.071933 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:36.072363 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.073316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:36.073769 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:36.074189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.215205 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.225227 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.226822 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.228043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-78e89557-9ca8-482b-877a-d2e23c2b247b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.167786 Sep 01 16:37:36.228597 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 282/563] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:36 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:36.712771 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8e4e5ffc-5b0f-40b2-9f3a-7231df059258 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: .version_select at 0x7fe379fef8b0>, body: {"keypair": {"name": "tempest-keypair-248271050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJOee4R+dnyEFmH0YHgrH+mn5n9zhIL8/VPfhLHOVc+q/zH21Q0ClteU/3dlTA7M7Kfh7ld/1SskXoWUwB8uzqJ3e6GnbxZqD2V7NQ4c8HmT9WtEeIqaV3NxV9j/5+png=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:36.729222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-8e4e5ffc-5b0f-40b2-9f3a-7231df059258 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for project a994270b8e1f43328b827696f9d89bb0. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:37:36.732907 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-8e4e5ffc-5b0f-40b2-9f3a-7231df059258 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for user 8a45ee95cf5947c49584ff403facaff7 and project a994270b8e1f43328b827696f9d89bb0. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:37:36.868921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8e4e5ffc-5b0f-40b2-9f3a-7231df059258 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159915 Sep 01 16:37:36.869655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 282/564] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:37:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:37.261026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:37.261633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:37.273942 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.274127 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.274755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:37.275654 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.276247 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.276788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:37.445516 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.454260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.456255 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.457452 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-42c3c295-92a3-408a-8388-29c89005932b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.205323 Sep 01 16:37:37.458013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 283/565] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:37 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:38.481446 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:38.482027 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:38.488473 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:38.488956 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:38.489389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:38.491543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:38.491543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:38.491543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:38.715780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.726901 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.728709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.730466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-620d491d-c988-4482-b793-5ed8a5c3709a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1743 microversion: 2.20 time: 0.253546 Sep 01 16:37:38.743641 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 283/566] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:38 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:39.729594 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-492531756", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1eb71281-5889-42b9-a660-ae574bf041ed"}], "security_groups": [{"name": "tempest-securitygroup--767297094"}], "key_name": "tempest-keypair-248271050", "user_data": "}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:39.759457 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:39.760741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:39.768121 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.769046 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.769404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:39.770193 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.770721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.771250 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:39.791333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:39.928627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] validate_networks() for [('1eb71281-5889-42b9-a660-ae574bf041ed', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:37:39.967946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:39.977065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:39.985239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:39.985239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8befeb28-8387-45cc-a6b0-aa32bbe5d02f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1743 microversion: 2.20 time: 0.224354 Sep 01 16:37:39.985239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 284/567] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:39 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1743 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:40.554324 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:37:40.554754 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:37:40.555304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:37:40.555891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:37:40.556305 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:37:40.565316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:40.565919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:40.566389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:40.567177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:40.567695 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:40.568228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:40.587118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for project a994270b8e1f43328b827696f9d89bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:37:40.591109 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for user 8a45ee95cf5947c49584ff403facaff7 and project a994270b8e1f43328b827696f9d89bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:37:40.602365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:37:40.604696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:37:40.773750 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-397f2ec9-2916-4dcb-9f76-2a5f41c2e848 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.048777 Sep 01 16:37:40.778591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 284/568] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:37:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:37:40.797653 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c399f53e-8ab9-471d-bda4-ce26d77a3317 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:40.798822 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c399f53e-8ab9-471d-bda4-ce26d77a3317 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:40.872890 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c399f53e-8ab9-471d-bda4-ce26d77a3317 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:40.880787 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c399f53e-8ab9-471d-bda4-ce26d77a3317 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1240 microversion: 2.1 time: 0.093893 Sep 01 16:37:40.881371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 285/569] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:40 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:41.005709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:41.006401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:41.014475 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.015108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.015761 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.016788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.017443 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.018116 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.168096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:41.177019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:41.178474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:41.179708 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-edb7c073-415d-4f3a-9511-1627b5149a71 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1743 microversion: 2.20 time: 0.178508 Sep 01 16:37:41.180289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 285/570] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:41 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:41.843519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-fe3827b3-f349-4f0f-9e49-9e48766eea66 req-54400200-2ef3-4bd4-851e-05d5184cfbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f", "name": "network-vif-plugged", "status": "completed", "tag": "7528df97-c3e6-4a5e-8a1c-e62df28e6f83"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:41.855428 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fe3827b3-f349-4f0f-9e49-9e48766eea66 req-54400200-2ef3-4bd4-851e-05d5184cfbe9 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.856076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fe3827b3-f349-4f0f-9e49-9e48766eea66 req-54400200-2ef3-4bd4-851e-05d5184cfbe9 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.856690 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fe3827b3-f349-4f0f-9e49-9e48766eea66 req-54400200-2ef3-4bd4-851e-05d5184cfbe9 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.868445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-fe3827b3-f349-4f0f-9e49-9e48766eea66 req-54400200-2ef3-4bd4-851e-05d5184cfbe9 service nova] Creating event network-vif-plugged:7528df97-c3e6-4a5e-8a1c-e62df28e6f83 for instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f on hv-cinder-83602 Sep 01 16:37:41.873524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-fe3827b3-f349-4f0f-9e49-9e48766eea66 req-54400200-2ef3-4bd4-851e-05d5184cfbe9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034030 Sep 01 16:37:41.874310 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 286/571] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:41.902200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:41.902869 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:41.910622 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.911058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.911513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.912836 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.913397 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.913818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.984165 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:41.993287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5de9f021-2794-4584-b840-a6aa66e1a061 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1244 microversion: 2.1 time: 0.095054 Sep 01 16:37:41.993880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 286/572] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:41 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:42.208045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:42.208045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:42.213778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:42.214273 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:42.214710 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:42.215437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:42.215891 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:42.216317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:42.359341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.368275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.369811 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.370987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d0760d58-7ea8-49ff-8295-a0e6d5c539fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1743 microversion: 2.20 time: 0.172663 Sep 01 16:37:42.371581 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 287/573] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:42 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:43.015738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:43.016381 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:43.023606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.024078 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.024603 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.025287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.025734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.026145 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.091287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.094927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:43.101194 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dc345a43-545a-4a88-a8d5-b3046715bbc3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1292 microversion: 2.1 time: 0.089299 Sep 01 16:37:43.101918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 287/574] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:43 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:43.394713 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:43.395336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:43.402059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.402882 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.403656 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.404854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.405617 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.406339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.539594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.547850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.551131 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.551131 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d2cb51b2-13ca-4a56-9c00-82ce04e952fb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1743 microversion: 2.20 time: 0.160794 Sep 01 16:37:43.551516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 288/575] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:43 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:44.126455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:44.129128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:44.137289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.139451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.139451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.139451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.139451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.139949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.219126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.227736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3b85b7c8-c912-4092-b6e1-1c07e48bc72e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1292 microversion: 2.1 time: 0.107375 Sep 01 16:37:44.228311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 288/576] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:44 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1292 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:44.574178 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:44.574790 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:44.582761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.592198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.592198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.592198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.592198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.593162 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.739674 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.747965 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.749558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.750905 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-08fcc37b-54eb-4a67-a5ee-b648af1d2da3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1743 microversion: 2.20 time: 0.180898 Sep 01 16:37:44.751524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 289/577] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:44 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:45.256282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:45.256282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:45.264720 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.265224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.265672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.266386 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.266840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.267412 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.338442 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:45.346740 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-36a52193-c178-4b33-9143-4f19ecc75d41 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1292 microversion: 2.1 time: 0.098168 Sep 01 16:37:45.347691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 289/578] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:45 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:45.391512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:45.392127 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:45.401242 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.420068 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.420068 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.420068 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.420068 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.420505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.622328 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:45.631576 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7242c972-65b4-4139-9389-c5a21c4028c9 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1594 microversion: 2.1 time: 0.243848 Sep 01 16:37:45.635828 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 290/579] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:45 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1594 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:45.775358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:45.776213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:45.787450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.788857 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.791829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.791829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.791829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.791829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:46.000700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:46.015021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:46.016665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:46.018671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f70584bd-9baa-4a72-8558-6caf83ff727b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1743 microversion: 2.20 time: 0.247908 Sep 01 16:37:46.019427 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 290/580] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:45 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:46.367785 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:46.368393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:46.374265 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:46.374746 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:46.375179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:46.375897 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:46.376342 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:46.376757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:46.626193 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:46.634767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f11b7946-5d3e-4e29-bc01-68d979838b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.270786 Sep 01 16:37:46.648881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 291/581] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:46 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:47.042695 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:47.044975 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:47.048794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:47.057892 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.058567 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.059213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.060089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.060699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.061267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.256334 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.270907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.273112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.274831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1511e7cf-fbe0-47f6-9470-ad545efc2424 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.236419 Sep 01 16:37:47.276191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 291/582] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:47 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:47.605858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-636e7735-6ac8-43ad-a0a1-3604cbb21740 req-c0b8d114-51ff-4a34-9dc4-4b968cea4005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc571669-74b7-49a8-b7db-1cdfd8b5fa61", "tag": "c6b607d8-c6da-4e49-9ef6-25f87cbaa132"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:47.625163 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-636e7735-6ac8-43ad-a0a1-3604cbb21740 req-c0b8d114-51ff-4a34-9dc4-4b968cea4005 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.625552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-636e7735-6ac8-43ad-a0a1-3604cbb21740 req-c0b8d114-51ff-4a34-9dc4-4b968cea4005 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.625990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-636e7735-6ac8-43ad-a0a1-3604cbb21740 req-c0b8d114-51ff-4a34-9dc4-4b968cea4005 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.663598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:47.663816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-636e7735-6ac8-43ad-a0a1-3604cbb21740 req-c0b8d114-51ff-4a34-9dc4-4b968cea4005 service nova] Creating event network-changed:c6b607d8-c6da-4e49-9ef6-25f87cbaa132 for instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 on hv-cinder-83602 Sep 01 16:37:47.665124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:47.672084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-636e7735-6ac8-43ad-a0a1-3604cbb21740 req-c0b8d114-51ff-4a34-9dc4-4b968cea4005 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068776 Sep 01 16:37:47.673530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.673692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 292/583] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:47.675187 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.677815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.677815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.677815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.677815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.950908 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.961408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dafff6da-dd5c-4937-ba32-986deb029d23 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.303267 Sep 01 16:37:47.973950 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 292/584] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:47 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:48.336868 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:48.337536 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:48.344270 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.345137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.345806 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.346769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.347418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.348022 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.458396 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-45e2bce0-eac6-488f-89f3-18d0e99ab0ee req-4a2cdc2e-cae5-4f2c-8f71-4ac56028f6ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63da505-aaed-4f08-a8f8-a3dc1a11cf27", "tag": "9f8b31c0-0f62-4b60-8cd2-e60302efe717"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:48.489430 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-45e2bce0-eac6-488f-89f3-18d0e99ab0ee req-4a2cdc2e-cae5-4f2c-8f71-4ac56028f6ec service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.490341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-45e2bce0-eac6-488f-89f3-18d0e99ab0ee req-4a2cdc2e-cae5-4f2c-8f71-4ac56028f6ec service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.493833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-45e2bce0-eac6-488f-89f3-18d0e99ab0ee req-4a2cdc2e-cae5-4f2c-8f71-4ac56028f6ec service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.530579 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-45e2bce0-eac6-488f-89f3-18d0e99ab0ee req-4a2cdc2e-cae5-4f2c-8f71-4ac56028f6ec service nova] Creating event network-changed:9f8b31c0-0f62-4b60-8cd2-e60302efe717 for instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 on hv-cinder-83602 Sep 01 16:37:48.537414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-45e2bce0-eac6-488f-89f3-18d0e99ab0ee req-4a2cdc2e-cae5-4f2c-8f71-4ac56028f6ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088488 Sep 01 16:37:48.542586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 293/585] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:48.657817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:48.668161 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:48.669624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:48.679904 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-304fc127-11a3-45d8-896a-ff198714e4d7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.347319 Sep 01 16:37:48.680813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 293/586] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:48 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:48.986565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:48.987636 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:48.998332 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.011854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.011854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.011854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.011854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.012220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.373232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:49.384299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2cd14034-2af8-4f02-8038-567206859e65 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.403459 Sep 01 16:37:49.397783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 294/587] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:48 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:49.711398 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:49.712107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:49.719786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.720410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.721192 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.721877 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.722412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.723025 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.959718 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:49.980984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:49.982736 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:49.984286 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-686dd6cc-bf25-4184-ba54-e645185d14ea tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.278292 Sep 01 16:37:49.995823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 294/588] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:49 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:50.428423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:50.430649 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:50.457146 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:50.457844 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:50.458410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:50.460553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:50.461077 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:50.461592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:50.586470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:50.600082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=6 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:50.692405 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:50.704793 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-69601340-e006-4377-ad18-8fdf1ab6211c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.302867 Sep 01 16:37:50.705983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 295/589] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:50 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:51.010174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:51.010795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:51.013371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:51.019351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.020127 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.020733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.021613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.022235 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.022678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.203262 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:51.239590 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:51.250643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:51.254119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-08295302-3ead-42e2-b7fb-1334a214b67a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.246697 Sep 01 16:37:51.276922 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 295/590] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:51 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:51.745825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:51.747274 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:51.754759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.755276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.755732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.756562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.757184 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.757759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.964364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:51.974881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e10a23d2-c591-477d-b74b-390a09b55eff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.237334 Sep 01 16:37:51.977790 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 296/591] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:51 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:52.292196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:52.293147 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:52.318126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:52.318126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:52.318126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:52.318126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:52.319227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:52.319227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:52.535706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:52.549306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:52.549306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:52.550259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8bb82141-717f-4ccf-83f9-4a97e1b61946 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.261879 Sep 01 16:37:52.554675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 296/592] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:52 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:53.004297 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:53.004919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:53.011650 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.012112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.012541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.013238 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.013684 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.014100 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.039781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-25938545"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:53.040724 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:53.043107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:53.048335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.048833 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.049839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.050735 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.051399 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.051831 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.176984 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:53.186343 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-475fbd65-1af6-4763-a809-47974a0606e6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.186693 Sep 01 16:37:53.191679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 297/593] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:52 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:53.219318 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.network.security_group_api [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Adding security group 0e70fc25-c0e4-4535-bb6f-493744e81b76 to port 9f8b31c0-0f62-4b60-8cd2-e60302efe717 Sep 01 16:37:53.578996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:53.579977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:53.591196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.591196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.591196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.591196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.592302 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.592798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.736145 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c6d4f7c7-d8e9-477b-980d-425154d8442f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "POST /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/action" status: 202 len: 0 microversion: 2.1 time: 0.700498 Sep 01 16:37:53.738017 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 297/594] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:37:53 2022] POST /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/action => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:53.746541 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:53.747753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:53.759496 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.764574 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.765501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.767418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.769988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.773289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.843849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:53.853680 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:53.856080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:53.857421 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-efe91dd3-b85a-4fe8-86d5-07a14e8081a3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.287378 Sep 01 16:37:53.873444 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 298/595] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:53 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:53.882681 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-f4cffa1a-8096-447d-92be-fdda86c5cb13 req-b348c85a-d585-46d3-b2df-d6b976157499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63da505-aaed-4f08-a8f8-a3dc1a11cf27", "tag": "9f8b31c0-0f62-4b60-8cd2-e60302efe717"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:53.921935 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f4cffa1a-8096-447d-92be-fdda86c5cb13 req-b348c85a-d585-46d3-b2df-d6b976157499 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.923755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f4cffa1a-8096-447d-92be-fdda86c5cb13 req-b348c85a-d585-46d3-b2df-d6b976157499 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.924925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f4cffa1a-8096-447d-92be-fdda86c5cb13 req-b348c85a-d585-46d3-b2df-d6b976157499 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.956983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-f4cffa1a-8096-447d-92be-fdda86c5cb13 req-b348c85a-d585-46d3-b2df-d6b976157499 service nova] Creating event network-changed:9f8b31c0-0f62-4b60-8cd2-e60302efe717 for instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 on hv-cinder-83602 Sep 01 16:37:53.971896 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-f4cffa1a-8096-447d-92be-fdda86c5cb13 req-b348c85a-d585-46d3-b2df-d6b976157499 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091693 Sep 01 16:37:53.972579 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 299/596] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:54.055562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:54.090606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-09c9d47b-7e01-4253-9e37-ae3144c72428 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1639 microversion: 2.1 time: 0.348353 Sep 01 16:37:54.092072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 298/597] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:53 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1639 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:54.209927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:54.210651 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:54.231252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.231641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.232081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.232787 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.233238 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.233674 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.438094 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:54.449971 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d4b29f5d-c02f-4af0-8e88-b72b7473792c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.244934 Sep 01 16:37:54.455934 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 300/598] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:54 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:54.889159 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:54.890278 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:54.913784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.915405 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.919569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.922302 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.923026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.923605 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:55.135697 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:55.147972 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:55.150804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:55.152383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b2da3d7d-3273-4dde-bfd4-2550aadc3143 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.271756 Sep 01 16:37:55.168678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 299/599] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:54 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:55.490101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:55.493441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:55.505278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:55.508073 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:55.508694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:55.509458 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:55.509909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:55.510325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:55.771690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:55.780766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e2d49a23-89b6-433a-9cf3-b53b31f18241 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.300839 Sep 01 16:37:55.781672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 301/600] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:55 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:56.108309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-add5db26-0243-4782-a011-54930f1dde11 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:56.116651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-add5db26-0243-4782-a011-54930f1dde11 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.117165 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-add5db26-0243-4782-a011-54930f1dde11 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.117722 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-add5db26-0243-4782-a011-54930f1dde11 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.182455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:56.183031 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:56.196019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.196795 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.197436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.198315 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.199029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.199658 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.206748 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-add5db26-0243-4782-a011-54930f1dde11 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Going to try to stop instance {{(pid=127531) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 16:37:56.530226 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:56.538271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-add5db26-0243-4782-a011-54930f1dde11 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/action" status: 202 len: 0 microversion: 2.1 time: 0.456578 Sep 01 16:37:56.540552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 300/601] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:37:56 2022] POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:56.543596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:56.547513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:56.567389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a4a0fa03-532c-4c94-8d84-b59f9c4bab0c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.370803 Sep 01 16:37:56.567389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 302/602] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:56 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:56.568067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:56.568067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:56.568737 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.572098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.572626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.573555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.574284 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.577308 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.742282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:56.757022 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1a3caa03-af72-40a0-866f-596345c19ec6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.210747 Sep 01 16:37:56.758144 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 301/603] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:56 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:56.806790 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:56.806790 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:56.819761 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.821580 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.822751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.824804 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.826240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.827352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.928668 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:56.934814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:56.949757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.950370 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.951129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.951908 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.952359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.952773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:57.031636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:37:57.045575 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:57.190547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:57.201722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f11b5a18-616d-4695-997d-82d726fc673f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.403845 Sep 01 16:37:57.202353 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 303/604] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:56 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:57.588255 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:57.588877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:57.595621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:57.596707 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:57.597145 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:57.597847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:57.598337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:57.598766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.043852 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:58.052479 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:58.054177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:58.057752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-25b60e61-08e4-4b08-b911-ba207ab04887 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.471674 Sep 01 16:37:58.057752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 304/605] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:57 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:58.060777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:58.061380 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:58.076299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.076892 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.077340 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.078076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.078535 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.078960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.093453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2af42986-bb89-4928-a2e9-08cdfda275da tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 204 len: 0 microversion: 2.1 time: 1.191998 Sep 01 16:37:58.097217 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 302/606] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:37:56 2022] DELETE /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 0 bytes in 1195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:37:58.106415 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:58.107342 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:58.128895 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.129751 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.130720 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.132288 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.133268 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.136764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.410549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:58.414734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:58.417016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:58.422314 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c785031b-c2ed-4ae4-8f9a-52ab3cee517f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.365348 Sep 01 16:37:58.423173 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 305/607] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:58 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:58.427592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dc1311bf-9e79-4a30-a626-4ec491d146f9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1514 microversion: 2.1 time: 0.327176 Sep 01 16:37:58.428760 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 303/608] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:58 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1514 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:58.430383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:58.431988 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:58.442245 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.446689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.446689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.446689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.446689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.447721 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.504699 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-b261d155-0145-44a1-b4e3-e4e039a00ff7 req-550c511b-c1d9-4460-ad7c-acc9f351be17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc571669-74b7-49a8-b7db-1cdfd8b5fa61", "name": "network-vif-plugged", "status": "completed", "tag": "c6b607d8-c6da-4e49-9ef6-25f87cbaa132"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:58.553805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-b261d155-0145-44a1-b4e3-e4e039a00ff7 req-550c511b-c1d9-4460-ad7c-acc9f351be17 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:58.555554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-b261d155-0145-44a1-b4e3-e4e039a00ff7 req-550c511b-c1d9-4460-ad7c-acc9f351be17 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:58.561513 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-b261d155-0145-44a1-b4e3-e4e039a00ff7 req-550c511b-c1d9-4460-ad7c-acc9f351be17 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.587302 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-b261d155-0145-44a1-b4e3-e4e039a00ff7 req-550c511b-c1d9-4460-ad7c-acc9f351be17 service nova] Creating event network-vif-plugged:c6b607d8-c6da-4e49-9ef6-25f87cbaa132 for instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 on hv-cinder-83602 Sep 01 16:37:58.600727 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-b261d155-0145-44a1-b4e3-e4e039a00ff7 req-550c511b-c1d9-4460-ad7c-acc9f351be17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106558 Sep 01 16:37:58.602630 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 304/609] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:58.729241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:58.746867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-77eee024-e10e-499d-a496-78c1e6886fe9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.320470 Sep 01 16:37:58.754679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 306/610] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:58 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:59.083072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:59.084256 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:59.092982 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.093812 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.094395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.095202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.095761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.096679 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.336695 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.351704 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.353368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.354672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ee206b14-79c9-4067-aa22-19ce6ad3a6e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.277495 Sep 01 16:37:59.363908 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 305/611] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:59 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:59.453474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:59.453848 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:59.454273 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:59.454777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:59.464114 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.464947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.465887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.467083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.468017 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.468168 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.468836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.469755 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.470099 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.470813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.471190 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.473010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.691058 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.702256 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f396e4fe-0072-4d64-9bbe-811f3fcaf6bb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1514 microversion: 2.1 time: 0.253359 Sep 01 16:37:59.708210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 306/612] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:59 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:59.734162 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.745731 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-82e68f9b-7737-447f-9374-1034533d0e47 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.302371 Sep 01 16:37:59.746619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 307/613] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:59 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:59.779851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:59.780580 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:59.789324 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.790311 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.791904 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.792797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.793266 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.793693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.973034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.985057 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3bb1155c-eb8a-4e02-b6aa-a0e8d2b0057f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.209203 Sep 01 16:37:59.986120 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 307/614] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:59 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:00.400711 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:00.401365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:00.414870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.415518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.416200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.417171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.417817 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.418243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.604769 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:00.616120 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:00.617641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:00.618854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0c773184-b663-455c-9647-dd1e8b0a6a33 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.222266 Sep 01 16:38:00.619448 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 308/615] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:00 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:00.725577 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:00.727788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:00.735035 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.735545 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.735972 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.738217 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.738749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.739384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.769129 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:00.770007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:00.779855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.780489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.780947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.782193 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.784126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.784664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.968619 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:00.982501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3a97d3b4-8108-4ded-b052-9c907062c9c4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1514 microversion: 2.1 time: 0.261258 Sep 01 16:38:00.985432 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 308/616] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:00 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:01.011888 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:01.012794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:01.025428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:01.032631 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.033871 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.034557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.035743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.036517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.037183 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.051523 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a7e59e25-e67b-4da9-ba13-531ed6965933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.286104 Sep 01 16:38:01.052848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 309/617] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:00 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:01.228525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:01.237982 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-20f03d97-648e-427d-b15e-fcbf01574b29 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.232765 Sep 01 16:38:01.239035 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 309/618] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:01 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:01.652915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:01.654059 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:01.673505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.677270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.678523 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.681532 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.683649 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.684509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.912877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:01.943528 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:01.946491 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:01.949806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8fcadc5f-44e7-48d4-87a9-29c675d0d593 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.301744 Sep 01 16:38:01.964879 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 310/619] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:01 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:02.016128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:02.016792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:02.024827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.025084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.025434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.026169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.026626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.027733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.108413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:02.108413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:02.108413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.108413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.109082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.109082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.109082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.109082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.216237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:02.223038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b59c0f6-ed4f-4dda-b28a-6235b329ebd9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1514 microversion: 2.1 time: 0.211275 Sep 01 16:38:02.223952 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 310/620] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:02 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:02.262100 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:02.262719 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:02.273310 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.273902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.274601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.275946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.276639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.277361 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.278536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:02.289666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-77859051-1f29-4d3c-ad19-992f62161a00 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.210791 Sep 01 16:38:02.289666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 311/621] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:02 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:02.430388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:02.444657 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9d95d023-eca5-4fdd-92b2-26510293a64e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.186838 Sep 01 16:38:02.445248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 311/622] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:02 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:02.656866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-44dc03d5-385b-41ea-ae57-a61f382c3c11 req-55613df1-6527-4849-b865-566dafbfadbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c1f79f-e737-474c-baa4-da016497a1c6", "name": "network-vif-deleted", "tag": "4f65a033-a5ab-4e8e-815d-247b4f5ed126"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:02.685484 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-44dc03d5-385b-41ea-ae57-a61f382c3c11 req-55613df1-6527-4849-b865-566dafbfadbf service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.686225 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-44dc03d5-385b-41ea-ae57-a61f382c3c11 req-55613df1-6527-4849-b865-566dafbfadbf service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.686849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-44dc03d5-385b-41ea-ae57-a61f382c3c11 req-55613df1-6527-4849-b865-566dafbfadbf service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.704357 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-44dc03d5-385b-41ea-ae57-a61f382c3c11 req-55613df1-6527-4849-b865-566dafbfadbf service nova] Creating event network-vif-deleted:4f65a033-a5ab-4e8e-815d-247b4f5ed126 for instance 31c1f79f-e737-474c-baa4-da016497a1c6 on hv-cinder-83602 Sep 01 16:38:02.712757 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-44dc03d5-385b-41ea-ae57-a61f382c3c11 req-55613df1-6527-4849-b865-566dafbfadbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059165 Sep 01 16:38:02.714760 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 312/623] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:02.977384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:02.978135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:02.985528 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.987869 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.987869 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.988392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.988872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.989339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.154960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:03.175436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:03.177267 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:03.180334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f14f1fd1-1307-4009-bb31-7d14a2acfc15 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.206059 Sep 01 16:38:03.180334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 312/624] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:02 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:03.272851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:03.274438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:03.286840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.288074 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.289010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.290385 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.291584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.292519 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.319696 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:03.320813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:03.332035 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.332834 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.333570 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.334733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.335537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.336235 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.394840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:03.403439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a2dacef2-9108-4fb5-8290-7b97e619a0a6 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1304 microversion: 2.1 time: 0.138096 Sep 01 16:38:03.404032 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 313/625] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:03 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:03.466131 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:03.466947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:03.474011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.474500 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.474926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.475670 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:03.476138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:03.476727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:03.496863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:03.506379 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-40d3efa5-1cb6-439e-912c-b6f27a23ea51 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.194952 Sep 01 16:38:03.509733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 313/626] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:03 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:03.626834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:03.635877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e03bbde8-a532-4672-9194-1491b8d8cc4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1365 microversion: 2.1 time: 0.173813 Sep 01 16:38:03.636472 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 314/627] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:03 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:04.205766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:04.206750 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:04.213720 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.214300 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.214826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.215626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.216142 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.216660 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.356828 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:04.375924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:04.377955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:04.379138 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0b1ef3f3-608d-4819-8c4f-ba9822dda41d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1738 microversion: 2.20 time: 0.177286 Sep 01 16:38:04.379727 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 314/628] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:04 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:04.425950 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:04.426573 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:04.433004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.433475 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.433898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.434582 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.435027 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.435467 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.469010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.469478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.469906 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.470354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lazy-loading 'fault' on Instance uuid 31c1f79f-e737-474c-baa4-da016497a1c6 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:04.522063 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:04.529290 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:04.529920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:04.531182 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-71540169-f611-4d29-9c09-0b4a8bc1534a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 200 len: 1309 microversion: 2.1 time: 0.109580 Sep 01 16:38:04.532083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 315/629] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:04 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:04.536588 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.537082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.537517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.538220 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.538670 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.539089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.658038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:04.659460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:04.665862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.666439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.666883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.667629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.668081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.668499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.676069 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:04.685719 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cb126920-1f34-4057-9026-6172a6dc12b0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.160651 Sep 01 16:38:04.686701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 315/630] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:04 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:04.942648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:04.951259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7e4f80f5-c66a-41f4-8785-37e7f55380ec tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1555 microversion: 2.1 time: 0.297208 Sep 01 16:38:04.951946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 316/631] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:04 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:04.974619 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-536ec07f-892e-4ebd-8c2a-4324b1789870 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:04.975114 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-536ec07f-892e-4ebd-8c2a-4324b1789870 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:04.981160 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-536ec07f-892e-4ebd-8c2a-4324b1789870 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.981644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-536ec07f-892e-4ebd-8c2a-4324b1789870 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.983472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-536ec07f-892e-4ebd-8c2a-4324b1789870 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:04.983472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-536ec07f-892e-4ebd-8c2a-4324b1789870 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:04.983472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-536ec07f-892e-4ebd-8c2a-4324b1789870 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:04.983762 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-536ec07f-892e-4ebd-8c2a-4324b1789870 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.067706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-536ec07f-892e-4ebd-8c2a-4324b1789870 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097282 Sep 01 16:38:05.068296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 316/632] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 16:38:04 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:05.402341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:05.403698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:05.411183 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.411690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.412139 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.412853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.413296 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.413720 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.555233 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:05.555869 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: 31c1f79f-e737-474c-baa4-da016497a1c6] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:05.562116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.563339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:05.563858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.563858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.564035 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.564781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.565457 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.577811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:05.580356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:05.580743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] HTTP exception thrown: Instance 31c1f79f-e737-474c-baa4-da016497a1c6 could not be found. Sep 01 16:38:05.582231 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-60cae2c8-7788-4f8c-afc2-f249d49b87de tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1720 microversion: 2.20 time: 0.183549 Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Request method failure captured: Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 HTTP/1.1 Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN9VfOP2Sn8-7o41NX0VKfP-deFgN56YLJA9bxhUjVIfiMkhXQA1gubY2lR2hfiSb_nUboNKDAcQKaH7cdjJa_RwXRsTpYoIctXQJ89IzpPKsQPO_v9HTJ-qbi3STH3qbdZlHUmDqJpaTgoNT86Azr0xDiSkQd5acP9ey63wuHcdC7M Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: 98240e01aaa84f3e8c7e425ad2c9eb4f Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesSnapshotTestJSON-180613873 Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:38:05.582815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98240e01aaa84f3e8c7e425ad2c9eb4f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98240e01aaa84f3e8c7e425ad2c9eb4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98240e01aaa84f3e8c7e425ad2c9eb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98240e01aaa84f3e8c7e425ad2c9eb4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesSnapshotTestJSON-180613873 Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 98240e01aaa84f3e8c7e425ad2c9eb4f Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-180613873 Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesSnapshotTestJSON-180613873-project Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 3a32dcea37fb4255823fec5eb5c57e00 Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesSnapshotTestJSON-180613873-project Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance 31c1f79f-e737-474c-baa4-da016497a1c6 could not be found. Sep 01 16:38:05.584519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '31c1f79f-e737-474c-baa4-da016497a1c6'} Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c1f79f-e737-474c-baa4-da016497a1c6 could not be found. Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:38:05.586525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c1f79f-e737-474c-baa4-da016497a1c6 could not be found. Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c1f79f-e737-474c-baa4-da016497a1c6 could not be found. Sep 01 16:38:05.588214 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:38:05.589555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Returning 404 to user: Instance 31c1f79f-e737-474c-baa4-da016497a1c6 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:38:05.589555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5c51cfde-61ec-4f8f-986c-e51b070a982f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6" status: 404 len: 111 microversion: 2.1 time: 0.034849 Sep 01 16:38:05.592421 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 317/633] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:05 2022] GET /compute/v2.1/servers/31c1f79f-e737-474c-baa4-da016497a1c6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:38:05.600170 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 317/634] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:05 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:05.708349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:05.709439 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:05.716042 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.716372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.716803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.717595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.718170 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.718642 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.988530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:05.997531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7c3e8342-82d7-41d6-963b-a4b1a43c82e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.293441 Sep 01 16:38:05.998215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 318/635] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:05 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:06.346972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-db38a1d5-7eca-424a-b6e3-897f0a0240cc req-19738b51-25ce-4c95-93c9-35b0980ec9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f", "name": "network-vif-unplugged", "status": "completed", "tag": "7528df97-c3e6-4a5e-8a1c-e62df28e6f83"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:06.362689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-db38a1d5-7eca-424a-b6e3-897f0a0240cc req-19738b51-25ce-4c95-93c9-35b0980ec9b3 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.363618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-db38a1d5-7eca-424a-b6e3-897f0a0240cc req-19738b51-25ce-4c95-93c9-35b0980ec9b3 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.364393 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-db38a1d5-7eca-424a-b6e3-897f0a0240cc req-19738b51-25ce-4c95-93c9-35b0980ec9b3 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.382668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-db38a1d5-7eca-424a-b6e3-897f0a0240cc req-19738b51-25ce-4c95-93c9-35b0980ec9b3 service nova] Creating event network-vif-unplugged:7528df97-c3e6-4a5e-8a1c-e62df28e6f83 for instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f on hv-cinder-83602 Sep 01 16:38:06.390228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-db38a1d5-7eca-424a-b6e3-897f0a0240cc req-19738b51-25ce-4c95-93c9-35b0980ec9b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049634 Sep 01 16:38:06.391077 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 318/636] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:06.615027 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:06.615661 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:06.622383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.622870 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.623363 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.624065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.624525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.624928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.643448 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:06.847013 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:06.857726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:06.859572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:06.860919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb561fa1-9092-48c3-a328-31ebe9b7ba4f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1720 microversion: 2.20 time: 0.250517 Sep 01 16:38:06.861486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 319/637] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:06 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:06.863262 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-cefff809-051c-4c9d-b0ca-7b30f35da745 req-f5517996-b38a-429f-a75a-ee2896826543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc571669-74b7-49a8-b7db-1cdfd8b5fa61", "tag": "c6b607d8-c6da-4e49-9ef6-25f87cbaa132"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:06.873022 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-cefff809-051c-4c9d-b0ca-7b30f35da745 req-f5517996-b38a-429f-a75a-ee2896826543 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.873405 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-cefff809-051c-4c9d-b0ca-7b30f35da745 req-f5517996-b38a-429f-a75a-ee2896826543 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.873818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-cefff809-051c-4c9d-b0ca-7b30f35da745 req-f5517996-b38a-429f-a75a-ee2896826543 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.886212 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-cefff809-051c-4c9d-b0ca-7b30f35da745 req-f5517996-b38a-429f-a75a-ee2896826543 service nova] Creating event network-changed:c6b607d8-c6da-4e49-9ef6-25f87cbaa132 for instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 on hv-cinder-83602 Sep 01 16:38:06.891303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-cefff809-051c-4c9d-b0ca-7b30f35da745 req-f5517996-b38a-429f-a75a-ee2896826543 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033391 Sep 01 16:38:06.891907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 319/638] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:38:07.020044 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:07.020662 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:07.026933 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.027473 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.027913 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.028614 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.029076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.029501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.179681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:07.188228 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d57bdc4d-4e39-4638-94b8-bfaba629aef1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.172219 Sep 01 16:38:07.188805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 320/639] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:07 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:07.886998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:07.887847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:07.894368 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.894941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.895475 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.896256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.896727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.897153 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.046795 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:08.056168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:08.056168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:08.057220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3ff0bdd3-d06a-45ce-b562-e96f2612a4b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1720 microversion: 2.20 time: 0.174986 Sep 01 16:38:08.057780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 320/640] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:07 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:08.212022 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:08.212712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:08.220161 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:08.220666 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:08.221623 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.222878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:08.223761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:08.224227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.385283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:08.394569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fa2a5d3e-db9b-4e66-8e8a-efada0cf7fa9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.186515 Sep 01 16:38:08.395184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 321/641] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:08 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:09.081694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:09.082329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:09.101089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.101572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.102000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.102703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.103199 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.103618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.248462 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:09.257771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:09.259247 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:09.260431 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e1b8105f-a0ca-4344-9ca2-c474559606ef tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1720 microversion: 2.20 time: 0.183349 Sep 01 16:38:09.261009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 321/642] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:09 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:09.416335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:09.416923 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:09.423580 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.424077 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.424709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.425995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.426541 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.427174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.627709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:09.636123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-85792a51-b32a-4df3-9399-0b2082ff54df tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.223698 Sep 01 16:38:09.636714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 322/643] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:09 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:10.294887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:10.295599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:10.303301 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.303780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.304215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.304915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.305364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.305793 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.439092 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:10.447381 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:10.448823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:10.450232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-11d67c89-1c37-4f97-80cd-2c25dc2059cd tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1720 microversion: 2.20 time: 0.159246 Sep 01 16:38:10.450787 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 322/644] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:10 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:10.657600 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:10.658208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:10.665003 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.665485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.665911 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.666593 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.667039 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.667484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.804438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:10.813490 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d20fe552-5129-4df6-a32d-27939e6eefe5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.159746 Sep 01 16:38:10.814159 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 323/645] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:10 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:11.473678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:11.474299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:11.481222 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:11.481697 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:11.482125 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:11.482811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:11.483296 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:11.483752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:11.620207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:11.628943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:11.630397 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:11.631592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-595daedc-6752-4633-b9b6-5b32628a9e66 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1720 microversion: 2.20 time: 0.162602 Sep 01 16:38:11.632180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 323/646] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:11 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:11.969210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:11.969210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:11.976388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:11.976881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:11.977301 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:11.978150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:11.978596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:11.979013 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.229114 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:12.239023 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dbad0a09-6f92-47c9-b378-4f8ecddab22e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.405626 Sep 01 16:38:12.239633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 324/647] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:11 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:12.777058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:12.777058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:12.781576 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.782034 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.782496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.783215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.784362 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.784978 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.789266 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:12.945193 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:12.953743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:12.955203 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:12.956603 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-05bc3434-6ea3-4798-96dd-d02b223a6e18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1723 microversion: 2.20 time: 0.306391 Sep 01 16:38:12.957259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 324/648] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:12 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:12.979015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cac4bbfa-540f-462f-95bd-46f3f5a44b51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dec31cf-4021-4bf6-89d0-f5052c8089a0"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:12.981536 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cac4bbfa-540f-462f-95bd-46f3f5a44b51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:12.989082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac4bbfa-540f-462f-95bd-46f3f5a44b51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.999942 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac4bbfa-540f-462f-95bd-46f3f5a44b51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.999942 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac4bbfa-540f-462f-95bd-46f3f5a44b51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.999942 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac4bbfa-540f-462f-95bd-46f3f5a44b51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.999942 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac4bbfa-540f-462f-95bd-46f3f5a44b51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.000367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cac4bbfa-540f-462f-95bd-46f3f5a44b51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.262530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:13.266959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:13.271123 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:13.271642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.272070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.272846 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:13.273357 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.273863 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.419430 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:13.429910 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bf4354d7-c9c8-426b-82e6-e938f72bef83 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.171364 Sep 01 16:38:13.430604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 325/649] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:13 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:14.382743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cac4bbfa-540f-462f-95bd-46f3f5a44b51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.407582 Sep 01 16:38:14.383455 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 325/650] 10.222.0.16 () {62 vars in 1364 bytes} [Thu Sep 1 16:38:12 2022] POST /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments => generated 188 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:38:14.454180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:14.454997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:14.462750 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.463342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.463824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.464543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.464994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.465409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.516781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:14.518433 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:14.528545 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.529030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.529463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.530174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.530623 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.531038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.623083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:14.629127 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127531) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:38:14.632993 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-314972e8-3e34-49f9-a821-f17795b44d16 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.182918 Sep 01 16:38:14.633518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 326/651] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:14 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:14.900263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-792770a7-d9a5-45af-8880-c704d9597f87 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/action" status: 202 len: 0 microversion: 2.20 time: 0.387355 Sep 01 16:38:14.900791 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 326/652] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 1 16:38:14 2022] POST /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:38:14.912160 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:14.912776 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:14.918918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.919444 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.919874 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.920575 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.921021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.921433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.057405 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:15.067192 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:15.068947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:15.070240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-020b47eb-beb0-4093-94a8-0d41da4bcfad tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1749 microversion: 2.20 time: 0.163583 Sep 01 16:38:15.070801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 327/653] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:14 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:15.655136 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:15.655764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:15.664955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.665471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.665904 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.666667 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.667415 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.667843 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.844901 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:15.854224 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b8e03fc8-a596-4c6d-abc3-49b521ec054e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.203347 Sep 01 16:38:15.854805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 327/654] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:15 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:16.093998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:16.094680 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:16.101961 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.102512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.102951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.103678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.109424 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.109424 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.253169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:16.262418 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:16.263985 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:16.265151 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bedb2428-9b55-4f56-821c-0b2ce9f72ed6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1749 microversion: 2.20 time: 0.175027 Sep 01 16:38:16.265697 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 328/655] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:16 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:16.875939 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:16.876550 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:16.884181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.884709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.885175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:16.885889 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:16.886345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:16.886772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.029294 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:17.038075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-32978c0c-0856-4069-90ac-f2bffabb7755 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.166054 Sep 01 16:38:17.038648 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 328/656] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:16 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:17.289105 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:17.289708 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:17.296060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:17.296539 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:17.296970 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.297649 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:17.298384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:17.298502 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:17.446325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:17.460766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:17.462195 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:17.463441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c6dd5116-f303-45d5-8057-22b64ea6755d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1749 microversion: 2.20 time: 0.178197 Sep 01 16:38:17.463996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 329/657] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:17 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1749 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:18.058939 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:18.059579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:18.066341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.066825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.067298 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.067998 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.068572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.068960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.211591 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:18.219871 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fc8c1b0b-f643-4560-9f35-c26349ef05d8 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1724 microversion: 2.1 time: 0.164789 Sep 01 16:38:18.220411 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 329/658] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:18 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:18.486317 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:18.486949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:18.490673 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=80 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:18.494088 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.494567 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.494992 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.495719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:18.496168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:18.496583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:18.638447 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:18.650081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:18.651571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:18.652759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fb0d1c4c-06ca-4bee-b28e-987ea32437f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1749 microversion: 2.20 time: 0.170434 Sep 01 16:38:18.653312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 330/659] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:18 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:19.242515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:19.243045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:19.249793 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.250360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.250874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.251731 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.252294 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.253367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.393853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:19.402272 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-db5aa46b-ea0c-48ec-96f9-762cc32c224a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1701 microversion: 2.1 time: 0.164028 Sep 01 16:38:19.402849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 330/660] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:19 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1701 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:19.427554 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5b0a8ca4-e408-45e5-9c7b-15e550cac03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:19.435485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b0a8ca4-e408-45e5-9c7b-15e550cac03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.436189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b0a8ca4-e408-45e5-9c7b-15e550cac03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.436822 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b0a8ca4-e408-45e5-9c7b-15e550cac03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.493726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-498461067", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "networks": [{"uuid": "656dc81d-5348-4732-8b07-c30711591ca4"}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:19.533994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5b0a8ca4-e408-45e5-9c7b-15e550cac03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Going to try to start instance {{(pid=127532) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 16:38:19.551057 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] validate_networks() for [('656dc81d-5348-4732-8b07-c30711591ca4', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:38:19.751491 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5b0a8ca4-e408-45e5-9c7b-15e550cac03b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/action" status: 202 len: 0 microversion: 2.1 time: 0.331261 Sep 01 16:38:19.752874 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 331/661] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:38:19 2022] POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:38:19.761521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:19.762495 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:19.772055 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.772665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.775460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.775460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.775460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.775460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.939469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:19.951445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:38:19.954418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:38:19.954418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:38:19.954418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:38:19.954418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:38:19.962288 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:19.963773 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:19.964958 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2c71f7fc-8244-4216-873e-8a28867975b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1751 microversion: 2.20 time: 0.209837 Sep 01 16:38:19.979346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 332/662] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:19 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:19.985038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:19.988822 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:19.992329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.992826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.993313 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.994053 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.994506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.994783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.994925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.995317 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.995754 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:19.996450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:19.997170 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:19.997626 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:20.014237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Getting quotas for project 98240e01aaa84f3e8c7e425ad2c9eb4f. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:38:20.020515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Getting quotas for user 3a32dcea37fb4255823fec5eb5c57e00 and project 98240e01aaa84f3e8c7e425ad2c9eb4f. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:38:20.032599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:38:20.036292 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:38:20.151463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5ec01a2a-9e0a-41b6-b0a9-158614028bc7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661743 Sep 01 16:38:20.152295 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 331/663] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:38:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:38:20.164198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-26c6b7cc-5841-4eef-9120-7ddfd739c87d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:20.165102 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-26c6b7cc-5841-4eef-9120-7ddfd739c87d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:20.169037 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:20.179635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c7ec4371-d5c6-4101-9280-6bb3b271e5f1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1710 microversion: 2.1 time: 0.198699 Sep 01 16:38:20.188706 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 333/664] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:19 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1710 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:20.260326 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-26c6b7cc-5841-4eef-9120-7ddfd739c87d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:20.276208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-26c6b7cc-5841-4eef-9120-7ddfd739c87d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1218 microversion: 2.1 time: 0.116314 Sep 01 16:38:20.277173 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 332/665] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:20 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:21.000889 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:21.001629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:21.008562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.009080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.009513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.010207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.010661 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.011180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.162746 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.171532 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.172951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.174128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8a09bb13-9cac-4e3b-9bbd-ad1609ec9f4c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.181880 Sep 01 16:38:21.175417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 334/666] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:20 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:21.212805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:21.213393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:21.216355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:21.219784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.220246 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.220681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.221368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.223007 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.223569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.298015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:21.298628 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:21.306439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.306439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.307136 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.307498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:21.308134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:21.308546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:21.380520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.391246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a09c20a5-2f81-47fe-b8a8-977417c56984 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1222 microversion: 2.1 time: 0.097168 Sep 01 16:38:21.391944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 335/667] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:21 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:21.408804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:21.420714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-744a2629-8a85-4bd1-a421-b08ef711d21a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1710 microversion: 2.1 time: 0.211543 Sep 01 16:38:21.421311 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 333/668] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:21 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1710 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:22.198191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:22.198801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:22.206403 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.207108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.207713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.208402 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.208848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.209259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.355509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.361926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.363504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.364686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bc119654-3c7b-41f9-a68a-ce1c07bf64ba tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.170435 Sep 01 16:38:22.365259 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 336/669] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:22 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:22.420897 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:22.425242 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:22.432146 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.432637 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.433064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.433767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.434351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.435013 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.439803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:22.442731 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:22.443464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:22.449425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.449906 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.450623 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.451587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:22.452015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:22.453220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:22.538807 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.551022 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-17841b26-77b7-41fe-86bf-5b9433a1cc3a tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1214 microversion: 2.1 time: 0.136637 Sep 01 16:38:22.552162 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 334/670] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:22 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:22.624026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:22.633254 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4c2c2283-bed5-49a8-b78c-ae3f343e80c4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1714 microversion: 2.1 time: 0.195042 Sep 01 16:38:22.633956 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 337/671] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:22 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1714 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:23.390045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:23.390690 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:23.398556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.399044 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.399498 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.400195 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.400636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.401048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.567090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.572887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:23.573490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:23.576522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.610592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.610592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-adec5981-8bff-4a85-a52d-378492215c19 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.193097 Sep 01 16:38:23.610592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 335/672] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:23 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:23.610957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.610957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.610957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.610957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:23.611325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:23.611325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:23.655689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:23.663596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0e2060c1-8945-4cb5-85af-3b08df1b66a1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1270 microversion: 2.1 time: 0.094489 Sep 01 16:38:23.664168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 338/673] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:23 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:24.605297 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:24.606278 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:24.614397 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.615043 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.615856 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.616635 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.617207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.617702 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.687267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:24.687976 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:24.694805 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.695326 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.695761 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.696460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:24.697029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:24.697318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:24.854004 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.868004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.872740 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:24.878191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.878857 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d83d2b12-0ec4-4e80-afe0-5edd32e16e1b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.197450 Sep 01 16:38:24.880010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 339/674] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:24 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:24.881198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:24.882590 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-21d27f2e-946f-417c-ab37-e35de439fab6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.282228 Sep 01 16:38:24.883309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 336/675] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:24 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:25.900693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:25.901345 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:25.907178 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:25.908406 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:25.913230 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.913230 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.913230 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.913230 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.913807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.915467 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.916913 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.917728 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.921259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:25.921259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:25.921259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:25.921259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:26.085770 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.090335 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.097059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.098854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:26.100432 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dcbc53f8-7125-4daa-b8b5-22b094e00a90 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.197039 Sep 01 16:38:26.101005 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 337/676] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:25 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:26.101320 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bce29104-2175-407c-97ad-46b2babb85fb tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.204587 Sep 01 16:38:26.102115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 340/677] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:25 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:27.124013 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:27.124796 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:27.125264 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.125432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:27.133186 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.133674 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.134463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.134561 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.134647 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.134829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.134994 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.135301 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.135742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:27.135854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.136198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:27.137105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:27.308375 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.322105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.323964 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.325452 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eeb64d22-3b06-4966-ae49-c5c9cf602232 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.205102 Sep 01 16:38:27.326356 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 338/678] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:27 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:27.327177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:27.336694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dcaccf8a-ac10-409f-b2f8-7e2809865703 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.216424 Sep 01 16:38:27.337312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 341/679] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:27 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:28.353705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:28.354501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:28.363114 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.363658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.364248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.364907 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.365367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.365804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.377725 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:28.380105 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:28.390690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.392093 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.393105 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.394575 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:28.395698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:28.396734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:28.547795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:28.557265 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:28.558723 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:28.559966 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-67f75717-d2e1-4a85-8b69-ff9c5b34c70a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.210913 Sep 01 16:38:28.560530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 339/680] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:28 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:28.564594 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:28.572977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-492e63ba-184b-4563-a5fb-4a55527b11e4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.206753 Sep 01 16:38:28.573646 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 342/681] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:28 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:29.585148 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:29.585761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:29.592309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.592792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.593255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.593771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:29.594314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.594409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:29.594500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.594790 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.602280 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.602788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.603279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.604007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:29.604520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:29.606184 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:29.744507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:29.753512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:29.754056 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:29.755549 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:29.756732 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d43fb552-0f0a-4e8f-a02e-002397ce3b2a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.176264 Sep 01 16:38:29.757307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 340/682] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:29 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:29.761410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a3b3f3fb-be34-4882-92a2-be44fab8ac86 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.171386 Sep 01 16:38:29.761989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 343/683] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:29 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:30.781296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:30.781880 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:30.782919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:30.783637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:30.783866 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:30.784877 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=8 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:30.791014 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.791249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.791695 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.791813 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.792335 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.792445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.792947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.793045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:30.793398 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.793717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:30.793865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.794364 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:30.963218 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:30.971692 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:30.972817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:30.974406 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:30.975736 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-53b10200-576a-4f62-a4a9-3cea1dfcaf4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.198801 Sep 01 16:38:30.976337 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 341/684] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:30 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:30.990128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-165a9724-2778-4d0f-806f-41c92be534d9 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.202867 Sep 01 16:38:30.990128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 344/685] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:30 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:32.003878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:32.004467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:32.008235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:32.009479 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:32.010555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.011045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.011512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.012472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.012939 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.013392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.021046 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.021535 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.021962 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.022667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:32.023115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:32.023559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:32.163931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.172309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9781c943-b768-4140-b263-f14ef0abc318 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.172467 Sep 01 16:38:32.173586 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 342/686] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:31 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:32.179470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.188448 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.189896 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:32.191671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-75e8f7c4-5e12-40c3-ad36-f0da619d85ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.191179 Sep 01 16:38:32.192226 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 345/687] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:31 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:33.195764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:33.197300 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:33.204641 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.205288 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.205730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.206545 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.207212 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.207590 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.224331 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:33.229346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:33.231764 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.232253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.232686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.233387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:33.233834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:33.234252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:33.391000 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.398984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a282b7a3-19ca-4ff1-a87e-e56223123953 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.207121 Sep 01 16:38:33.400542 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 343/688] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:33 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:33.422120 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.433605 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.440288 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:33.442754 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-96a6307a-caa8-471c-a02e-67a4557e570f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.222875 Sep 01 16:38:33.443851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 346/689] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:33 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:34.430200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:34.430200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:34.434373 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.434872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.435343 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.436080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.436532 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.436953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.480147 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:34.485358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:34.488646 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.489133 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.489593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.490285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:34.490726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:34.491138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:34.587788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:34.610481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7055745a-64ae-403e-91e5-673257521079 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.187625 Sep 01 16:38:34.616320 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 344/690] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:34 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:34.686335 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:34.696152 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:34.697590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:34.698757 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-49745f6c-58d3-4c92-9dd0-e7c3657145c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.229286 Sep 01 16:38:34.699352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 347/691] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:34 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:35.636806 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:35.637412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:35.644534 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.645215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.645679 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.646437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.646921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.647378 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.724046 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:35.725357 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:35.732182 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.732666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.733085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.733959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:35.734619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:35.735209 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:35.890650 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:35.899814 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:35.901311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:35.902441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8510e414-5e7d-43e4-be3c-7e49d2363bb8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.183664 Sep 01 16:38:35.903044 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 348/692] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:35 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:36.051365 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:36.058938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3cc4dd4-78dc-4a32-81b4-e45029a6b630 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.425981 Sep 01 16:38:36.059580 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 345/693] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:35 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:36.927660 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:36.928214 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:36.935363 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.935855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.936431 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:36.937227 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:36.937738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:36.938174 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.091450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.091717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:37.091717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:37.091717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.091717 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.092374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.092468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.092567 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:37.092567 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:37.092567 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:37.092781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.094394 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-30b2daaa-8230-469a-98b1-0b5d54ce3cd0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.170603 Sep 01 16:38:37.094394 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 349/694] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:36 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:37.240464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:37.267988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-16bb5123-7f6b-439b-a7b1-5f52aa77ead1 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.171939 Sep 01 16:38:37.267988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 346/695] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:37 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:38.118129 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.118744 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.125211 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.125685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.126113 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.126799 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.127276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.127696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.269625 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.279207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.280642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.281807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1266876b-a525-4a3d-93b4-e0de2d0a3b4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.167669 Sep 01 16:38:38.282360 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 350/696] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:38.293839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:38.294469 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:38.301874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.302359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.302781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.303796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:38.304244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:38.304659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:38.453731 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:38.461523 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ee2b2824-a304-4a89-ae70-39308d4decb3 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.171589 Sep 01 16:38:38.462090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 347/697] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:38 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:39.305790 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:39.306442 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:39.314079 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.314792 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.315423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.316509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.317096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.317624 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.462548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:39.474371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:39.477588 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:39.478953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-95ef43f1-e0d3-49ff-a237-c87b3d63abdb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.177698 Sep 01 16:38:39.479553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 351/698] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:39 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:39.482102 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:39.482762 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:39.489865 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.490346 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.490778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.491511 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:39.491970 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:39.492400 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:39.641786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:39.649431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dd80cfb2-1b47-4333-b729-392678571bfd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.171255 Sep 01 16:38:39.650024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 348/699] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:39 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:40.502752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:40.503925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:40.510287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.510768 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.511240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.511925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.512373 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.512831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.544571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-9bad0456-8237-4821-8401-5809a3a5f7cb req-bfad8d21-20be-43c1-83d6-05df2af8f5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11b8782-c2e8-4e9e-933a-1d09c5fa7e86", "tag": "c8c533d5-6cba-43e0-85b6-f8d6a3e2abe5"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:40.554706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-9bad0456-8237-4821-8401-5809a3a5f7cb req-bfad8d21-20be-43c1-83d6-05df2af8f5d3 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.555428 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-9bad0456-8237-4821-8401-5809a3a5f7cb req-bfad8d21-20be-43c1-83d6-05df2af8f5d3 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.555852 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-9bad0456-8237-4821-8401-5809a3a5f7cb req-bfad8d21-20be-43c1-83d6-05df2af8f5d3 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.571073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-9bad0456-8237-4821-8401-5809a3a5f7cb req-bfad8d21-20be-43c1-83d6-05df2af8f5d3 service nova] Creating event network-changed:c8c533d5-6cba-43e0-85b6-f8d6a3e2abe5 for instance a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 on hv-cinder-83602 Sep 01 16:38:40.576516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-9bad0456-8237-4821-8401-5809a3a5f7cb req-bfad8d21-20be-43c1-83d6-05df2af8f5d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035198 Sep 01 16:38:40.577147 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 349/700] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:40.656033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.664754 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.666657 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.667884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-56b1f18d-ed27-4a87-a348-83e7d941d7a2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.169194 Sep 01 16:38:40.668451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 352/701] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:40 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:40.671077 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:40.671798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:40.678838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.679856 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.679856 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.680811 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:40.681327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:40.681747 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:40.819838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:40.827812 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3b164e0-eb5d-4f50-8ce1-ff19351bf0d8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.161384 Sep 01 16:38:40.828385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 350/702] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:40 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:41.691538 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:41.692199 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:41.698602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.699080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.699611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.700302 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.700750 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.701429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.836708 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.845613 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.847134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:41.848338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ca5826c4-2e1b-4603-a4c7-7420a2d84da9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.160722 Sep 01 16:38:41.848537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:41.849007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 353/703] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:41 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:41.849928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:41.856773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.857256 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.857687 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.858382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:41.858831 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:41.859276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:41.874874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:41.997328 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:42.005857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5abe2e8c-2a27-445e-b38a-d28fc8211224 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.161495 Sep 01 16:38:42.006484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 351/704] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:41 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:42.870894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:42.871464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:42.877946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.878470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.879023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:42.879768 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:42.880220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:42.880639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.014322 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.024285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.025744 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.026883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:43.027389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-db36be22-38cd-493a-8e6a-22db41b9afa4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.160067 Sep 01 16:38:43.027494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 354/705] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:42 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:43.027585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:43.034039 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.034573 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.034997 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.035716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:43.036166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:43.036583 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:43.165484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:43.173244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5fe869cd-a464-41d0-b284-5847ab0c3326 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.150049 Sep 01 16:38:43.173820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 352/706] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:43 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:44.049093 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:44.049684 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.056161 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.056642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.057074 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.057766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.058216 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.058635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.188346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.197897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.199369 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.200545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9c60cd5c-53b1-49ba-b5a5-ff93656c3fb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.155351 Sep 01 16:38:44.201360 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 355/707] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:44 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:44.202201 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:44.202814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:44.210369 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.210984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.211292 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.211976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:44.212414 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:44.212823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:44.347718 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:44.355371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0fbed0fc-8443-4f3c-8468-b6a3e65e5cab tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.157318 Sep 01 16:38:44.355937 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 353/708] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:44 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:45.224945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:45.225554 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:45.232417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.232904 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.233338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.234042 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.234489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.234906 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.254311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:45.373977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:45.375879 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:45.377147 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:45.383851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.384415 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.384551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:45.384783 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.385476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:45.385926 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:45.386171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:45.386347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:45.387381 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-68dde4be-cf94-4542-a6c0-b0e64e86358d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.166962 Sep 01 16:38:45.388154 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 356/709] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:45 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:45.517585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:45.526226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-71086f36-ef93-4e1b-8041-a5f9fa3cebf7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.154154 Sep 01 16:38:45.526804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 354/710] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:45 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:46.412960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:46.413555 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:46.420036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.420394 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.420823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.421506 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.421952 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.422369 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.548187 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:46.548926 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:46.556297 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.556782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.557215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.557911 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:46.558360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:46.558776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:46.563885 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.572689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.574148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.575374 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ca3af686-daaf-4079-8d90-660c00e8269b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.166977 Sep 01 16:38:46.575944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 357/711] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:46 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:46.700474 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:46.709495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cb77123a-41a9-47d6-8516-ca61ca87c7a5 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.165585 Sep 01 16:38:46.710097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 355/712] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:46 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:47.599601 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:47.600203 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:47.606602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.607074 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.607530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.608649 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.609060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.731693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:47.732511 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:47.738383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:47.739369 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.739859 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.740307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.741032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:47.741468 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:47.741886 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:47.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:47.749872 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:47.751029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4c690ef5-8f93-4df0-91f3-be8a1996fb9e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.156490 Sep 01 16:38:47.751706 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 358/713] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:47 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:47.873589 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:47.882069 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0785bfb0-475b-4ac7-8a21-b7c51b39da9b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.154414 Sep 01 16:38:47.882636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 356/714] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:47 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:48.775275 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:48.775912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:48.778329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=58 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:48.783022 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.783609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.783984 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.785235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.785684 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.786107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.903170 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:48.903794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:48.912027 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.912512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.912941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.913643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:48.914131 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:48.914503 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:48.929534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.938474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.939939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:48.941857 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2c15a125-31dc-463d-8ef9-5b12030a8de3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.170048 Sep 01 16:38:48.942434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 359/715] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:48 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:49.054527 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:49.062169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e7690c7f-2988-4c43-9d53-fefeb6d2d675 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.162871 Sep 01 16:38:49.062768 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 357/716] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:48 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:49.966166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:49.966820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:49.973558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.974040 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.974473 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:49.975190 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:49.975634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:49.976050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.082638 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:50.083377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:50.090080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:50.090570 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:50.091006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.091767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:50.092222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:50.092643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:50.115479 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.124426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.125857 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.127008 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-58782815-ac35-4f4b-9b98-82c7ea4d350d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.165112 Sep 01 16:38:50.127596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 360/717] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:49 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:50.232983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:50.242155 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b1383526-b254-4e0b-9e29-6853a52b11c7 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.163856 Sep 01 16:38:50.242779 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 358/718] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:50 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:51.151273 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:51.151979 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:51.158683 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.159176 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.159787 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.160705 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.161358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.161777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.262122 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:51.263540 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:51.271135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.271655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.272092 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.272813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:51.273263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:51.273689 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:51.300642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.309784 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.311248 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.313675 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0a42b641-56a9-48ed-b4b5-499b09fcee18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.165209 Sep 01 16:38:51.313675 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 361/719] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:51 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:51.407805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:51.416065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0824d3b6-9d12-4f01-b3b6-3b8d2cd6839e tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.157920 Sep 01 16:38:51.416640 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 359/720] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:51 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:52.337189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:52.337772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:52.345470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.345946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.346373 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.347224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.347738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.348165 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.436326 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:52.436940 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:52.439386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=53 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:52.444796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.445293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.445722 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.446427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.446902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.447351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.487752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.496736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.498218 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.499723 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-be0131bf-36df-4f9a-b35f-086e8b34ad0d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.166192 Sep 01 16:38:52.500012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 362/721] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:52 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:52.588892 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:52.596507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-21ffe14a-3fa4-4ad1-b7f3-c63f051034c8 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.163977 Sep 01 16:38:52.597234 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 360/722] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:52 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:52.834371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-71b9624b-14a3-4e5a-b8aa-b172b9d8ccb8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fe42d15-d9f5-4a78-b485-c35674366742"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:52.836803 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-71b9624b-14a3-4e5a-b8aa-b172b9d8ccb8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:52.842908 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71b9624b-14a3-4e5a-b8aa-b172b9d8ccb8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.843427 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71b9624b-14a3-4e5a-b8aa-b172b9d8ccb8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.843871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71b9624b-14a3-4e5a-b8aa-b172b9d8ccb8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:52.844566 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71b9624b-14a3-4e5a-b8aa-b172b9d8ccb8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:52.845013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71b9624b-14a3-4e5a-b8aa-b172b9d8ccb8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:52.845434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-71b9624b-14a3-4e5a-b8aa-b172b9d8ccb8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.311047 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-116efd33-6543-4a87-9dcc-3bc2b0e31d12 req-9a6e1dd6-e43c-44c9-926f-4f20e48522bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11b8782-c2e8-4e9e-933a-1d09c5fa7e86", "name": "network-vif-plugged", "status": "completed", "tag": "c8c533d5-6cba-43e0-85b6-f8d6a3e2abe5"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:53.320875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-116efd33-6543-4a87-9dcc-3bc2b0e31d12 req-9a6e1dd6-e43c-44c9-926f-4f20e48522bb service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.321355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-116efd33-6543-4a87-9dcc-3bc2b0e31d12 req-9a6e1dd6-e43c-44c9-926f-4f20e48522bb service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.321783 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-116efd33-6543-4a87-9dcc-3bc2b0e31d12 req-9a6e1dd6-e43c-44c9-926f-4f20e48522bb service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.333248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-116efd33-6543-4a87-9dcc-3bc2b0e31d12 req-9a6e1dd6-e43c-44c9-926f-4f20e48522bb service nova] Creating event network-vif-plugged:c8c533d5-6cba-43e0-85b6-f8d6a3e2abe5 for instance a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 on hv-cinder-83602 Sep 01 16:38:53.338439 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-116efd33-6543-4a87-9dcc-3bc2b0e31d12 req-9a6e1dd6-e43c-44c9-926f-4f20e48522bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031025 Sep 01 16:38:53.339036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 361/723] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:38:53.523625 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:53.524319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:53.531333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.531820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.532262 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.532988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.533473 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.533903 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.669024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:53.678059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:53.679527 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:53.680697 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d5f0243f-3afe-4044-98f2-608a74b98643 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.161889 Sep 01 16:38:53.681255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 362/724] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:53 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:53.685609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:53.686210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:53.692537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.693015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.693471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.694171 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:53.694628 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:53.695048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:53.830955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-71b9624b-14a3-4e5a-b8aa-b172b9d8ccb8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.118373 Sep 01 16:38:53.837229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 363/725] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:38:52 2022] POST /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments => generated 194 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:53.857720 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:53.866708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7b68e9e2-2946-4c54-b6bf-ea14d5975dc0 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.184468 Sep 01 16:38:53.868590 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 363/726] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:53 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:54.705461 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:54.706159 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:54.713456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.713940 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.714376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.715082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.715571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.715999 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.861546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.871229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.872657 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:54.873820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a014025b-630f-417d-962e-054c36ec08e2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.173480 Sep 01 16:38:54.874379 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 364/727] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:54 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:54.888517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:54.889128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:54.896286 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.896775 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.897207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:54.898336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:54.898336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:54.898749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.036049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:55.043728 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da4e7acd-bb82-4707-b541-0b7e5d6d3968 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.159033 Sep 01 16:38:55.044297 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 364/728] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:54 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:55.897681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:55.898346 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:55.904471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.904950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.905374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.906164 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.906502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.906965 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.918929 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-a0f5235a-3727-42bf-8327-3e103cc08676 req-96dffe15-0b1c-4dba-bc9b-84bb8a8e9ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f", "name": "network-vif-plugged", "status": "completed", "tag": "7528df97-c3e6-4a5e-8a1c-e62df28e6f83"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:55.930457 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-a0f5235a-3727-42bf-8327-3e103cc08676 req-96dffe15-0b1c-4dba-bc9b-84bb8a8e9ff6 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:55.930932 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-a0f5235a-3727-42bf-8327-3e103cc08676 req-96dffe15-0b1c-4dba-bc9b-84bb8a8e9ff6 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:55.931384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-a0f5235a-3727-42bf-8327-3e103cc08676 req-96dffe15-0b1c-4dba-bc9b-84bb8a8e9ff6 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:55.945004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-a0f5235a-3727-42bf-8327-3e103cc08676 req-96dffe15-0b1c-4dba-bc9b-84bb8a8e9ff6 service nova] Creating event network-vif-plugged:7528df97-c3e6-4a5e-8a1c-e62df28e6f83 for instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f on hv-cinder-83602 Sep 01 16:38:55.955727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-a0f5235a-3727-42bf-8327-3e103cc08676 req-96dffe15-0b1c-4dba-bc9b-84bb8a8e9ff6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095256 Sep 01 16:38:55.955727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 365/729] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:56.064889 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:56.066911 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:56.072602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:56.073165 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:56.073672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:56.074439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:56.075067 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:56.075510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:56.107900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.118883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.120587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.121790 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-beefc817-712b-4197-856d-deec104232f4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.228473 Sep 01 16:38:56.122722 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 365/730] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:55 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:56.226162 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:56.233743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-85dea737-1248-4324-aae9-3fadca37587f tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1318 microversion: 2.1 time: 0.173249 Sep 01 16:38:56.234311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 366/731] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:56 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:57.145627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:57.146231 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:57.152771 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.153245 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.153669 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.154349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.154823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.155335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.255405 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:57.256038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:57.262392 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.262911 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.263377 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.264106 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.270274 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.270796 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.293874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:57.302932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:57.304387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:57.305747 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-11aa5b2f-37ed-4ab8-bbe7-4677735025d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.164976 Sep 01 16:38:57.306311 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 366/732] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:57 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:38:57.405567 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:57.414208 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1f108d16-6c27-4a08-9254-5bbad4be622b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1506 microversion: 2.1 time: 0.162642 Sep 01 16:38:57.414787 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 367/733] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:57 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:57.434706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e91fa9ae-117f-4439-9223-1b617e68df99 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "369fd1d6-0ba9-42d9-a94f-a3b51e32dcce", "device": "/dev/sdb"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:57.437289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e91fa9ae-117f-4439-9223-1b617e68df99 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:57.443927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e91fa9ae-117f-4439-9223-1b617e68df99 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.444410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e91fa9ae-117f-4439-9223-1b617e68df99 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.444840 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e91fa9ae-117f-4439-9223-1b617e68df99 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:57.445538 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e91fa9ae-117f-4439-9223-1b617e68df99 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:57.445989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e91fa9ae-117f-4439-9223-1b617e68df99 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:57.446408 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e91fa9ae-117f-4439-9223-1b617e68df99 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.328993 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:58.329599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:58.336661 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.337075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.337498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.338286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:58.338734 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:58.339169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:58.480066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.492435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.494247 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:58.495456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5d98ec9d-09b8-48cd-8a58-91f8f82c312d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.170651 Sep 01 16:38:58.496029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 368/734] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:58 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:38:58.755949 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:58.943326 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e91fa9ae-117f-4439-9223-1b617e68df99 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "POST /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.512528 Sep 01 16:38:58.943944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 367/735] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:38:57 2022] POST /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86/os-volume_attachments => generated 194 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:59.521765 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:59.522352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:59.529840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:59.530377 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:59.530872 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:59.531661 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:59.532156 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:59.532678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:59.667943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:59.676507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:59.677958 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:59.679141 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b28a263e-7177-4862-8e15-4f26f66ed6d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.162430 Sep 01 16:38:59.679732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 369/736] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:38:59 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:39:00.703817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:00.704543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:00.710753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:00.711263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:00.711696 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:00.712384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:00.712832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:00.713255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:00.851023 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.859753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.861233 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:00.862331 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-09957255-4f18-4e7d-bc76-041742fea0d3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.163516 Sep 01 16:39:00.864066 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 368/737] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:00 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:01.886735 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:01.887374 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:01.893815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.894310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.894743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:01.895587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:01.896008 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:01.896423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:02.034200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:02.044085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:02.045648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:02.046801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-112045e2-73f7-49d3-b578-c91baae8ccc3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.163990 Sep 01 16:39:02.047379 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 370/738] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:01 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:03.069565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:03.070168 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:03.079076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:03.079315 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:03.079991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:03.080740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:03.081232 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:03.082185 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:03.223309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.250264 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.251800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:03.252976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-03252b6e-bb64-4f0c-9996-3a196545f6fa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1807 microversion: 2.20 time: 0.187583 Sep 01 16:39:03.254255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 369/739] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:03 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:04.283338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:04.283977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:04.291468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.291954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.292376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.295623 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.296132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.296562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.430716 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:04.440551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:04.445229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:04.445229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4426b956-4de3-4d33-9af6-0348ee9072e5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1794 microversion: 2.20 time: 0.164278 Sep 01 16:39:04.445229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 371/740] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:39:04 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1794 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:39:04.570462 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:04.573255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:04.584584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.585085 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.589329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.589329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.589329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.589329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.614663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lazy-loading 'flavor' on Instance uuid db6a9ac9-616c-4e7b-a0f8-f37ba164254a {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:04.937492 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-18e1b518-cac1-4fc2-974c-e5bcdadd8b2b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/action" status: 200 len: 32 microversion: 2.1 time: 0.371131 Sep 01 16:39:04.938131 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 370/741] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:39:04 2022] POST /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/action => generated 32 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:39:04.949427 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:04.950154 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:04.958234 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.958726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.959175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.959903 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:04.960354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:04.960773 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:04.980140 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:05.100507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:05.108671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-90fa70c6-2864-417b-8593-17fb4f38ba98 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.163407 Sep 01 16:39:05.109249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 372/742] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:04 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:06.131782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:06.132483 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:06.138733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:06.139241 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:06.139679 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:06.140376 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:06.140829 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:06.141250 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:06.277095 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:06.285495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d004bcbe-bf39-4268-b832-2ba862e534e2 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.158558 Sep 01 16:39:06.286071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 371/743] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:06 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:07.306943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:07.307608 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:07.314737 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:07.315263 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:07.315703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:07.317054 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:07.317393 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:07.317822 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:07.460570 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:07.468910 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dd0d8194-207e-4513-b2c7-c3aa82495e0c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.165823 Sep 01 16:39:07.469585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 373/744] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:07 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:08.491002 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:08.491668 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:08.498276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:08.498694 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:08.499132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:08.499851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:08.500304 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:08.500724 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:08.640237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:08.649438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dddc3055-7ba4-428b-9c44-e8b27596e430 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.162574 Sep 01 16:39:08.650016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 372/745] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:08 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:09.670691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:09.671346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:09.678341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.678823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.679278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.679978 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:09.680427 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:09.680847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:09.811206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:09.820383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-41559812-0e0e-430a-ba79-31a616fac7c9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.153582 Sep 01 16:39:09.820964 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 374/746] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:09 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:10.842962 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:10.847678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:10.851331 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.851821 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.852246 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:10.852940 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:10.853381 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:10.853795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:11.008611 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:11.017814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ec1a8597-6852-4120-8609-00be42c2a1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.179386 Sep 01 16:39:11.018453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 373/747] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:10 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:12.041399 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:12.042039 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:12.048746 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.049227 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.049657 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.050349 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:12.050794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:12.051241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:12.185967 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:12.195666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b4b28cfe-a8c5-49af-a6e6-27b87d3a2fda tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.158107 Sep 01 16:39:12.196500 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 375/748] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:12 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:13.217797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:13.218450 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:13.226011 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.226496 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.226924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.227657 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:13.228100 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:13.228513 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:13.366342 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:13.374790 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3b6cc490-aa5c-42f5-b116-5315342647ca tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.160880 Sep 01 16:39:13.375385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 374/749] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:13 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:14.397008 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:14.397627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:14.404256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:14.404727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:14.405181 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:14.405878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:14.406330 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:14.406747 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:14.542239 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:14.558946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b3a1dc45-123a-4812-a041-ffac3e7ffd5e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.157277 Sep 01 16:39:14.558946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 376/750] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:14 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:15.572226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:15.572837 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:15.579716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:15.580198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:15.580625 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:15.581313 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:15.581788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:15.582205 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:15.725239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:15.733730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5b6bdb06-53de-4a84-8332-d0d3ac3c6f72 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.165389 Sep 01 16:39:15.734338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 375/751] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:15 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:16.755738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:16.756863 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:16.763372 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:16.763845 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:16.764269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:16.764953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:16.765396 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:16.765805 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:16.905722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:16.914308 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5b8faef1-5b78-4221-b14c-e1c8ae81ee95 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.162958 Sep 01 16:39:16.921438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 377/752] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:16 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:17.936719 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:17.937261 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:17.944750 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:17.945236 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:17.945665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:17.946355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:17.946799 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:17.947245 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:18.094633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:18.103498 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8e7f7f1f-10b5-4bcd-8f60-ca38f0fd45cb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.170597 Sep 01 16:39:18.104445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 376/753] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:17 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:19.126691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:19.127344 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:19.129802 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=38 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:19.135703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:19.136185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:19.136618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:19.137312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:19.137789 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:19.138207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:19.270386 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:19.283786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-824de656-4045-491e-b668-4c76ff1f3aa5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.161035 Sep 01 16:39:19.284374 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 378/754] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:19 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:20.305725 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:20.306360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:20.312947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:20.313393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:20.313820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:20.314509 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:20.314953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:20.315404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:20.453510 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:20.462648 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6d5a3457-05b1-4dcb-8e28-2b5c23f73017 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.160866 Sep 01 16:39:20.463250 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 377/755] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:20 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:21.483609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:21.484232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:21.491822 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:21.492301 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:21.492755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:21.493451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:21.493896 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:21.494309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:21.628581 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:21.637043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ee817163-ed02-48c9-b6b0-4d2ebf86bbe3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.157280 Sep 01 16:39:21.637620 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 379/756] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:21 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:22.660160 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:22.660778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:22.664184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=36 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:22.669190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.669748 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.670166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.670865 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.671364 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.677141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.808486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:22.816995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3110bb1b-1751-41e7-bbda-8149a15ba195 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.161143 Sep 01 16:39:22.817572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 378/757] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:22 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:23.030174 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-aa0b4ebb-5368-404c-90f2-ebd503365124 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:23.032516 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-aa0b4ebb-5368-404c-90f2-ebd503365124 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:23.041902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-aa0b4ebb-5368-404c-90f2-ebd503365124 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.042376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-aa0b4ebb-5368-404c-90f2-ebd503365124 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.042805 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-aa0b4ebb-5368-404c-90f2-ebd503365124 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.043611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-aa0b4ebb-5368-404c-90f2-ebd503365124 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.044053 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-aa0b4ebb-5368-404c-90f2-ebd503365124 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.044463 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-aa0b4ebb-5368-404c-90f2-ebd503365124 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.292609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-aa0b4ebb-5368-404c-90f2-ebd503365124 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "POST /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/action" status: 202 len: 0 microversion: 2.1 time: 0.266102 Sep 01 16:39:23.293254 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 380/758] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:39:23 2022] POST /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:39:23.301959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:23.303220 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:23.309703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.310190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.310653 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.311385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.311830 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.312244 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.463349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:23.471817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ac375e03-5a2e-439b-ab30-e0b7621a7027 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1749 microversion: 2.1 time: 0.173745 Sep 01 16:39:23.472402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 379/759] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:23 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:23.841068 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:23.841762 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:23.848122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.848654 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.849037 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.850507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:23.850954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:23.851404 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.995749 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:24.004494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-668e7386-4edb-4a3c-b9b7-60eb8bad67c8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.167542 Sep 01 16:39:24.005578 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 381/760] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:23 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:24.495853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:24.496464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:24.503065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.503511 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.503953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.504652 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.505103 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.505568 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.658531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:24.672000 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-68fe60a9-4b78-4d91-a2d8-0f6c93cb672a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1749 microversion: 2.1 time: 0.180009 Sep 01 16:39:24.672585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 380/761] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:24 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:25.026370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:25.026961 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:25.033645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.034137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.041104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:25.041104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.041104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.041104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:25.177223 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:25.187044 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-acc782e6-9349-44a4-b4a2-ce1117965198 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.164525 Sep 01 16:39:25.187720 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 382/762] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:25 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:25.694460 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:25.695078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:25.701719 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.702199 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.702633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:25.703708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.704091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.704538 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:25.856614 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:25.865395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-914a399b-d9e2-4368-b542-927e42feac6d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1749 microversion: 2.1 time: 0.175407 Sep 01 16:39:25.866204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 381/763] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:25 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:26.210286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:26.210942 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:26.217699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.218106 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.218538 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.219299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.219752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.220171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.379966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:26.389579 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dbabd9c5-95ce-4524-b821-025e852d0d3c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.184186 Sep 01 16:39:26.390164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 383/764] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:26 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:26.887878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:26.888447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:26.894924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.895338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.895773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.896516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.896967 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.897389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.900237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:27.050947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:27.060053 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ab5916c7-0273-48ba-a1e4-d8d7f94f54b4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1749 microversion: 2.1 time: 0.176169 Sep 01 16:39:27.060633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 382/765] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:26 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:27.412490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:27.413116 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:27.419772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.420251 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.420689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.421378 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.421817 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.422231 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.557782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:27.566170 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bb7f20a3-d34a-4445-8ecf-0a8963f82b24 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.158133 Sep 01 16:39:27.566954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 384/766] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:27 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:28.083174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:28.083985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:28.091565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.092060 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.092493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.093200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.093655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.094081 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.261392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:28.268379 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6607fda1-02e7-47d6-a817-ceaa3907467a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1749 microversion: 2.1 time: 0.189018 Sep 01 16:39:28.268966 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 383/767] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:28 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1749 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:28.589124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:28.589727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:28.595753 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.596233 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.596757 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.597437 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.597883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.598299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.741648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:28.750059 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8c9a10b7-163a-4cdb-a48b-857f8c8d55b7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.166543 Sep 01 16:39:28.750748 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 385/768] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:28 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:29.290311 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:29.290922 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:29.297674 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.298166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.298598 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.299337 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.299969 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.300395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.454257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:29.463267 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-67771bef-6dbd-40c9-8bd6-04d9afaba62f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.177290 Sep 01 16:39:29.464218 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 384/769] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:29 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:29.772810 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:29.773450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:29.780024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.780606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.781037 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.781721 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.782168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.782583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.915863 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:29.924349 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4b7e7ad4-03b4-4726-919c-4670fb52bcd7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.155951 Sep 01 16:39:29.924918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 386/770] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:29 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:30.495849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:30.496543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:30.504012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:30.504503 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:30.504935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:30.506455 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:30.506787 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:30.507235 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:30.663177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:30.671852 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4c572e8f-c695-4c22-ab22-e7ebe397b2cc tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.184640 Sep 01 16:39:30.672434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 385/771] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:30 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:30.947779 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:30.948397 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:30.955410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:30.955890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:30.957038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:30.957038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:30.957468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:30.957907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.093747 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:31.102838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d68ebbab-3962-42d7-a95e-689c490f5510 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.160257 Sep 01 16:39:31.103465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 387/772] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:30 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:31.683408 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:31.683920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:31.690448 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.690925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.693850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.693850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.693850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.694135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.694486 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:31.694879 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:31.703955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.704438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.704866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.705800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:31.708477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:31.708477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:31.712156 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:31.828195 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lazy-loading 'services' on Instance uuid a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:31.862459 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:31.871326 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7745a16d-62d9-428b-8959-49abeb94fc25 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.181361 Sep 01 16:39:31.871907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 388/773] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:31 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:32.077822 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-047fe965-0843-4d84-b213-95ef8a42abc4 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86/os-volume_attachments/369fd1d6-0ba9-42d9-a94f-a3b51e32dcce" status: 202 len: 0 microversion: 2.1 time: 0.398073 Sep 01 16:39:32.078345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 386/774] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:39:31 2022] DELETE /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86/os-volume_attachments/369fd1d6-0ba9-42d9-a94f-a3b51e32dcce => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:39:32.124272 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:32.124886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:32.132837 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.133333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.133777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.134470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.134945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.135435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.267198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:32.284611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4207ab12-928d-4c28-9bff-854dbbae0d60 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1737 microversion: 2.1 time: 0.164162 Sep 01 16:39:32.285193 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 389/775] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:32 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:32.894974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:32.895691 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:32.902605 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.903088 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.903547 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.904233 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.904678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.905090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.050492 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:33.059837 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-022d8be2-19fd-48aa-9982-07f351acab94 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.169498 Sep 01 16:39:33.060676 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 387/776] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:32 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:33.306545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:33.307172 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:33.313789 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.314274 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.314707 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.315430 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.315884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.316309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.448098 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:33.456496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-687207fd-a181-49aa-983c-a39827495c54 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1717 microversion: 2.1 time: 0.154556 Sep 01 16:39:33.457059 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 390/777] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:33 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:33.519361 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:33.519847 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:33.525721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.526999 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.527615 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.528638 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.529094 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.529512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.618156 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] HTTP exception thrown: Cannot 'detach_volume' instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a while it is in vm_state rescued Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Request method failure captured: Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments/3fe42d15-d9f5-4a78-b485-c35674366742 HTTP/1.1 Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN6_WXIC-4YN6U5LS5fcBrN0KP39ZYvQMD8k382YHVI5cm-TQjlHo434Iwnvp2M43ARHAt1XySyvgZfg-eLZWx-AsqeF_TeQMpbbefYTSKSZKNi-6Egiu0koZcd5nF49Z71Gs9TqbXZ6y86lUE-lrXeyHRcF1zBka3L9MIa8d37TEto Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:39:33.622565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f0958b1518e4439bf12959b7760abc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 8937e9f80f1540e389ee283971624741 Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:39:33.624016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Cannot 'detach_volume' instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a while it is in vm_state rescued Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'server_id': 'db6a9ac9-616c-4e7b-a0f8-f37ba164254a', 'id': '3fe42d15-d9f5-4a78-b485-c35674366742'} Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:33.624715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a while it is in vm_state rescued Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a while it is in vm_state rescued Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:39:33.625968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Returning 409 to user: Cannot 'detach_volume' instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a while it is in vm_state rescued {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:33.627355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-885a5553-b080-4c7d-8bfd-b731975ad5a5 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments/3fe42d15-d9f5-4a78-b485-c35674366742" status: 409 len: 152 microversion: 2.1 time: 0.106171 Sep 01 16:39:33.627355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 388/778] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:39:33 2022] DELETE /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments/3fe42d15-d9f5-4a78-b485-c35674366742 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:39:33.631541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b9e416cf-a137-4892-9910-e0e290aba469 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:33.632075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b9e416cf-a137-4892-9910-e0e290aba469 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:33.638151 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9e416cf-a137-4892-9910-e0e290aba469 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.638634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9e416cf-a137-4892-9910-e0e290aba469 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.641891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9e416cf-a137-4892-9910-e0e290aba469 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.641891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9e416cf-a137-4892-9910-e0e290aba469 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.641891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9e416cf-a137-4892-9910-e0e290aba469 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.641891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9e416cf-a137-4892-9910-e0e290aba469 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.871537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b9e416cf-a137-4892-9910-e0e290aba469 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "POST /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/action" status: 202 len: 0 microversion: 2.1 time: 0.243560 Sep 01 16:39:33.872388 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 391/779] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:39:33 2022] POST /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:39:33.881228 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:33.881938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:33.888936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.889421 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.889863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:33.890543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:33.890991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:33.891446 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.044148 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:34.054682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1dfe7055-9d29-4a86-b590-5a191cc8e49d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1725 microversion: 2.1 time: 0.178048 Sep 01 16:39:34.055291 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 389/780] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:33 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:34.083487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:34.085121 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:34.091453 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.091930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.092404 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.093135 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.093581 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.093998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.270686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:34.283110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5d2a1705-aa1d-40d1-a438-e042629b95f3 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.204487 Sep 01 16:39:34.285425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 392/781] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:34 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:34.292633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:34.292633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:34.292633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.292633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.293248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.293248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.293487 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.295075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.321814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:39:34.597598 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-adf20e0a-50d0-4fdc-8331-ef821cf881cd tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 204 len: 0 microversion: 2.1 time: 0.316732 Sep 01 16:39:34.598465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 390/782] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:39:34 2022] DELETE /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:34.608034 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:34.609211 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:34.615068 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.615912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.616371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.617068 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.617512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.617925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.756723 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:34.764569 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-272b3a68-28fb-418b-b61f-287b5e88e84b tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1512 microversion: 2.1 time: 0.160328 Sep 01 16:39:34.765145 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 393/783] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:34 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:35.076883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:35.077561 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:35.084882 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.085367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.085828 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.086528 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.086975 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.087428 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.220400 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:35.229495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c14be06d-ec28-43de-baf9-4adb94c36d55 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1725 microversion: 2.1 time: 0.156902 Sep 01 16:39:35.230076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 391/784] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:35 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:35.312687 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:35.313297 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:35.319487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.319998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.320433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.321120 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.321571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.321991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.463509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:35.471875 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dce25bd4-fcd7-427f-b27b-2ec1fc20f331 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.163008 Sep 01 16:39:35.472450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 394/785] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:35 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:35.785977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:35.786580 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:35.793329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.793808 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.794236 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.794928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.795405 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.795829 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.172876 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:36.181194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0d1744ae-dd79-4aa4-8be4-e20afb29bf94 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1512 microversion: 2.1 time: 0.399029 Sep 01 16:39:36.181766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 392/786] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:35 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:36.250716 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:36.251355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:36.259518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.260137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.260663 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.261464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.262006 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.262517 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.395083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:36.406786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9cb5f269-f927-4aab-b4ab-ec2f4d96f96c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1725 microversion: 2.1 time: 0.159785 Sep 01 16:39:36.407583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 395/787] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:36 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:36.554527 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:36.555199 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:36.561436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.561920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.562358 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.563059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.563542 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.563966 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.712566 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:36.720926 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2410ed35-eb3f-4841-bd0b-5e720a7cb443 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.170845 Sep 01 16:39:36.721499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 393/788] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:36 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:37.203294 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:37.204177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:37.210784 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.211290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.211720 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.212416 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.212866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.213331 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.353450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:37.363528 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f1db61cf-981f-4157-80c3-b8230c81f005 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1512 microversion: 2.1 time: 0.164012 Sep 01 16:39:37.364115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 396/789] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:37 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:37.436012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:37.436596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:37.443040 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.444409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.444994 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.445683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.446134 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.446552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.585634 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:37.594073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2a98a40a-1657-4a99-8e11-a5fe6e65744e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1725 microversion: 2.1 time: 0.161837 Sep 01 16:39:37.594672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 394/790] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:37 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:37.743033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:37.743690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:37.749709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.750180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.750604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.751330 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.751771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.752179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.898290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:37.906763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-298064e1-4d7b-472f-bcd3-4c21055946c1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.168452 Sep 01 16:39:37.907383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 397/791] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:37 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:38.385295 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:38.385902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:38.391982 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.392468 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.392901 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.393594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.394048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.394469 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.526113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:38.533991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-48e8f566-094d-4a8f-b3d9-3d8177e8ccb2 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1512 microversion: 2.1 time: 0.152477 Sep 01 16:39:38.534571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 395/792] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:38 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:38.615955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:38.616574 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:38.623007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.623527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.623960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.624653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.625107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.625525 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.762119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:38.770297 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b9098f6f-76f4-45d5-b554-8975c85b26d3 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1725 microversion: 2.1 time: 0.158680 Sep 01 16:39:38.770871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 398/793] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:38 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:38.929677 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:38.930274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:38.936395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.936872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.937296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.937978 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.938420 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.938828 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.956040 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:39.090336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:39.098772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-04b5d773-eca6-4eff-a643-36e58cce54ab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.173549 Sep 01 16:39:39.099352 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 396/794] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:38 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:39.555936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:39.556554 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:39.562530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.563010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.563472 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.564161 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.564607 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.565024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.698653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:39.706861 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-312eda33-ce34-4429-b46f-41070f3df203 tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1512 microversion: 2.1 time: 0.155485 Sep 01 16:39:39.707480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 399/795] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:39 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:39.792068 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:39.792866 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:39.799351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.799955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.800389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.801618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.801618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.801927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.018369 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:40.028919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4be037ae-b2f6-4d23-8f55-a5c622012207 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1725 microversion: 2.1 time: 0.241002 Sep 01 16:39:40.029595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 397/796] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:39 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:40.120732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:40.121235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:40.127140 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.129797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.129797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.129797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.129797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.130177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.288215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:40.297639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-37c24361-da6f-40f1-a2a2-f9d125654a49 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.180743 Sep 01 16:39:40.311491 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 400/797] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:40 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:40.384672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-04eeaf82-6fb1-4b8a-8f81-7276fbd4d4cd req-f8865506-f9d5-422c-84c4-5caf13bad304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11b8782-c2e8-4e9e-933a-1d09c5fa7e86", "name": "network-vif-deleted", "tag": "c8c533d5-6cba-43e0-85b6-f8d6a3e2abe5"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:40.394274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-04eeaf82-6fb1-4b8a-8f81-7276fbd4d4cd req-f8865506-f9d5-422c-84c4-5caf13bad304 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.394746 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-04eeaf82-6fb1-4b8a-8f81-7276fbd4d4cd req-f8865506-f9d5-422c-84c4-5caf13bad304 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.395191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-04eeaf82-6fb1-4b8a-8f81-7276fbd4d4cd req-f8865506-f9d5-422c-84c4-5caf13bad304 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.407076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-04eeaf82-6fb1-4b8a-8f81-7276fbd4d4cd req-f8865506-f9d5-422c-84c4-5caf13bad304 service nova] Creating event network-vif-deleted:c8c533d5-6cba-43e0-85b6-f8d6a3e2abe5 for instance a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 on hv-cinder-83602 Sep 01 16:39:40.412096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-04eeaf82-6fb1-4b8a-8f81-7276fbd4d4cd req-f8865506-f9d5-422c-84c4-5caf13bad304 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088827 Sep 01 16:39:40.413086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 398/798] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:40.729856 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:40.730435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:40.736959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.737432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.737855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.738543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.738985 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.739450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.776381 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.776860 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.777283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.777717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lazy-loading 'fault' on Instance uuid a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:40.821531 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a32dcea37fb4255823fec5eb5c57e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98240e01aaa84f3e8c7e425ad2c9eb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:40.832195 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8f59b988-f513-4db9-805a-52169d6b514d tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 200 len: 1308 microversion: 2.1 time: 0.107691 Sep 01 16:39:40.833240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 401/799] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:40 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:41.053218 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:41.054002 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:41.060533 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.061015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.061449 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.062143 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.062594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.063018 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.198776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:41.209207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f77e923a-fb89-43db-a9c6-f3b06c6ff1dc tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1731 microversion: 2.1 time: 0.161769 Sep 01 16:39:41.210246 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 399/800] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:41 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:41.235760 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-171f339f-5c04-4cd4-9afd-58873985c4e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:41.236241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-171f339f-5c04-4cd4-9afd-58873985c4e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:41.245081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-171f339f-5c04-4cd4-9afd-58873985c4e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.245571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-171f339f-5c04-4cd4-9afd-58873985c4e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.246240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-171f339f-5c04-4cd4-9afd-58873985c4e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.246952 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-171f339f-5c04-4cd4-9afd-58873985c4e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.247425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-171f339f-5c04-4cd4-9afd-58873985c4e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.247890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-171f339f-5c04-4cd4-9afd-58873985c4e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.322343 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:41.323073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:41.330007 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.330602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.331105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.331994 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.332524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.333020 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.341472 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-171f339f-5c04-4cd4-9afd-58873985c4e9 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110091 Sep 01 16:39:41.342088 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 402/801] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 16:39:41 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:41.499825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:41.508986 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7a9ef5b7-4962-48f6-8024-4f96a4f13b4a tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.192029 Sep 01 16:39:41.509646 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 400/802] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:41 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:41.854124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:41.854719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] [instance: a11b8782-c2e8-4e9e-933a-1d09c5fa7e86] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:41.861039 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.861522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.862047 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.862747 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.863220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.870173 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.879937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] HTTP exception thrown: Instance a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 could not be found. Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Request method failure captured: Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 HTTP/1.1 Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN9VfOP2Sn8-7o41NX0VKfP-deFgN56YLJA9bxhUjVIfiMkhXQA1gubY2lR2hfiSb_nUboNKDAcQKaH7cdjJa_RwXRsTpYoIctXQJ89IzpPKsQPO_v9HTJ-qbi3STH3qbdZlHUmDqJpaTgoNT86Azr0xDiSkQd5acP9ey63wuHcdC7M Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 98240e01aaa84f3e8c7e425ad2c9eb4f Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-VolumesSnapshotTestJSON-180613873 Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:39:41.882470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98240e01aaa84f3e8c7e425ad2c9eb4f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98240e01aaa84f3e8c7e425ad2c9eb4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98240e01aaa84f3e8c7e425ad2c9eb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98240e01aaa84f3e8c7e425ad2c9eb4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-VolumesSnapshotTestJSON-180613873 Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 98240e01aaa84f3e8c7e425ad2c9eb4f Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-180613873 Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-VolumesSnapshotTestJSON-180613873-project Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 3a32dcea37fb4255823fec5eb5c57e00 Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-VolumesSnapshotTestJSON-180613873-project Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 could not be found. Sep 01 16:39:41.884112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'a11b8782-c2e8-4e9e-933a-1d09c5fa7e86'} Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 could not be found. Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:41.885011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 could not be found. Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 could not be found. Sep 01 16:39:41.886409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:39:41.889383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] Returning 404 to user: Instance a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:41.890600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cd0823e3-c39b-4639-9acb-7a4f686cc3cf tempest-VolumesSnapshotTestJSON-180613873 tempest-VolumesSnapshotTestJSON-180613873-project] 10.222.0.16 "GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86" status: 404 len: 111 microversion: 2.1 time: 0.041420 Sep 01 16:39:41.891309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 403/803] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:41 2022] GET /compute/v2.1/servers/a11b8782-c2e8-4e9e-933a-1d09c5fa7e86 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:42.531283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:42.531881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:42.538919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.539487 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.543412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.543412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.543412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.543412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.724280 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-52507b4a-8503-434f-8d6d-75ef45e8f725 req-77967d45-0274-4a70-98d6-4dd8474cf86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6a9ac9-616c-4e7b-a0f8-f37ba164254a", "tag": "aa0e65b8-6c29-4bc7-a8bb-dd92861f558c"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:42.739327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:42.745468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-52507b4a-8503-434f-8d6d-75ef45e8f725 req-77967d45-0274-4a70-98d6-4dd8474cf86e service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.745870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-52507b4a-8503-434f-8d6d-75ef45e8f725 req-77967d45-0274-4a70-98d6-4dd8474cf86e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.751870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-52507b4a-8503-434f-8d6d-75ef45e8f725 req-77967d45-0274-4a70-98d6-4dd8474cf86e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.752607 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1018c6ce-c068-4bc3-aae3-fac26456cfb1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.224844 Sep 01 16:39:42.764775 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-52507b4a-8503-434f-8d6d-75ef45e8f725 req-77967d45-0274-4a70-98d6-4dd8474cf86e service nova] Creating event network-changed:aa0e65b8-6c29-4bc7-a8bb-dd92861f558c for instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a on hv-cinder-83602 Sep 01 16:39:42.767304 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 401/804] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:42 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:42.770217 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-52507b4a-8503-434f-8d6d-75ef45e8f725 req-77967d45-0274-4a70-98d6-4dd8474cf86e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149049 Sep 01 16:39:42.770824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 404/805] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:39:43.775334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:43.775996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:43.783019 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:43.783558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:43.784031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:43.784769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:43.785261 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:43.785704 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:43.944570 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:43.953110 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b463bc13-cd0c-4a39-a4f2-6c16ac3dc543 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.182734 Sep 01 16:39:43.956258 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 402/806] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:43 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:44.789539 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-589e5ad6-b951-4a23-9918-667f5f63a273 req-75ae8d17-d69e-481d-93aa-6eeaab357cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6a9ac9-616c-4e7b-a0f8-f37ba164254a", "tag": "aa0e65b8-6c29-4bc7-a8bb-dd92861f558c"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:44.799973 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-589e5ad6-b951-4a23-9918-667f5f63a273 req-75ae8d17-d69e-481d-93aa-6eeaab357cc4 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:44.800445 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-589e5ad6-b951-4a23-9918-667f5f63a273 req-75ae8d17-d69e-481d-93aa-6eeaab357cc4 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:44.800868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-589e5ad6-b951-4a23-9918-667f5f63a273 req-75ae8d17-d69e-481d-93aa-6eeaab357cc4 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:44.805856 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:44.813318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-589e5ad6-b951-4a23-9918-667f5f63a273 req-75ae8d17-d69e-481d-93aa-6eeaab357cc4 service nova] Creating event network-changed:aa0e65b8-6c29-4bc7-a8bb-dd92861f558c for instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a on hv-cinder-83602 Sep 01 16:39:44.818166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-589e5ad6-b951-4a23-9918-667f5f63a273 req-75ae8d17-d69e-481d-93aa-6eeaab357cc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033559 Sep 01 16:39:44.828680 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 405/807] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:44.976866 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:44.979963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:44.985213 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:44.985728 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:44.986196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:44.987257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:44.987753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:44.988368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:45.261029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:45.272671 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a8e02e85-90ee-463d-9e07-4949813fc190 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.299863 Sep 01 16:39:45.273728 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 403/808] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:44 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:46.297659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:46.298686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:46.309585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.310311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.310896 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.311998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.312530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.313097 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.501469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:46.510492 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ff8d847a-880f-459c-88d1-515dc97541d1 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.219537 Sep 01 16:39:46.511066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 406/809] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:46 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:47.533003 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:47.533615 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:47.540967 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.541454 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.541888 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:47.542602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.543115 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.543571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:47.722339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:47.732917 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-df32e5ba-225e-49e8-8abf-7978735f049d tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.203727 Sep 01 16:39:47.733548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 404/810] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:47 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:48.756039 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:48.756649 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:48.763456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:48.763940 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:48.764371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:48.765073 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:48.765526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:48.765957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:48.917973 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:48.926318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-99fb8036-487a-4cb7-9581-d8dce41a47b2 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.174207 Sep 01 16:39:48.926971 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 407/811] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:48 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:49.957984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:49.958741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:49.966050 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:49.966644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:49.967072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:49.967816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:49.968256 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:49.969155 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:50.135223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:50.148441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-563e901c-e9dd-4aa4-bdd1-e09ac3044700 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1754 microversion: 2.1 time: 0.194322 Sep 01 16:39:50.149356 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 405/812] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:49 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:51.171281 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:51.171894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:51.174485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=62 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:51.179989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.180470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.180916 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.181703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:51.182152 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:51.182567 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:51.334627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:51.342950 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fe294059-8f57-4c4e-bbce-c934a8a23cab tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1757 microversion: 2.1 time: 0.175632 Sep 01 16:39:51.343557 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 408/813] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:51 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:07.465675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:07.466234 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:07.468746 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:07.469420 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=53 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:07.474282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.474769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.475230 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.475938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.477026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.477462 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.562123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lazy-loading 'services' on Instance uuid c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:07.920558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e879e0a0-080e-48c7-8597-2e6a77a0536d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/os-volume_attachments/507a45dc-42ae-4828-bf65-4e43a8501dbf" status: 202 len: 0 microversion: 2.1 time: 0.458833 Sep 01 16:40:07.921512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 406/814] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:40:07 2022] DELETE /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/os-volume_attachments/507a45dc-42ae-4828-bf65-4e43a8501dbf => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:10.104921 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-05470c77-38e5-404b-8b4f-190e65eb6bed tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:10.107304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:40:10.114066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Thu Sep 1 16:40:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/action (ip 10.222.0.16) !!! Sep 01 16:40:10.114066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:10.114066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=18 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:10.116028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05470c77-38e5-404b-8b4f-190e65eb6bed tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.116495 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05470c77-38e5-404b-8b4f-190e65eb6bed tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.117089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05470c77-38e5-404b-8b4f-190e65eb6bed tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.143241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-05470c77-38e5-404b-8b4f-190e65eb6bed tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Going to try to stop instance {{(pid=127532) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 16:40:10.370132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-05470c77-38e5-404b-8b4f-190e65eb6bed tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/action" status: 202 len: 0 microversion: 2.1 time: 0.269100 Sep 01 16:40:10.370785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 409/815] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:40:10 2022] POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:10.380525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.381870 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.389115 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.389599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.390025 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.390724 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.391182 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.391602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.528519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.536281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6dc59182-b1d6-4f9c-b2f4-8a96e54e7a64 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.160788 Sep 01 16:40:10.536859 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 407/816] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:10 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:11.558656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:11.559503 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:11.565828 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.573293 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.573293 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.573293 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.573293 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.573710 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.717704 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:11.725646 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-224fb746-4bed-4d20-a6c1-ff500b094b8f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.172252 Sep 01 16:40:11.726241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 410/817] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:11 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:12.746572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:12.747287 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:12.754368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.754861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.755323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.756027 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.756474 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.756893 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.911855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:12.920981 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9f304c70-473c-488c-8550-653b7646679e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.178653 Sep 01 16:40:12.921659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 408/818] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:12 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:13.944148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:13.944715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:13.952048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.952537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.952965 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.953662 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:13.954108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:13.954526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.093309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:14.101249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a76a19dc-d2f3-4e9a-88d0-0f8537957b49 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.161067 Sep 01 16:40:14.102035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 411/819] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:13 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:15.124396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:15.125031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:15.131713 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.132195 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.132838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.133890 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:15.134338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:15.134758 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:15.327280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:15.336603 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-705afc05-86b9-4c85-9e13-6e79115e9f40 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.215175 Sep 01 16:40:15.337515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 409/820] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:15 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:16.359211 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:16.359814 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:16.366478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.367041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.367508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.368222 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.368665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.369090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.503854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:16.511482 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2d4a75c2-e31b-48df-a5a4-340b767dbba0 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.156149 Sep 01 16:40:16.512061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 412/821] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:16 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:17.534241 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:17.534828 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:17.542695 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.543211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.543626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.544313 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:17.544755 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:17.545168 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:17.684673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:17.692633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2e0cc9f5-de8e-4d2b-8b5b-ec139be1a126 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.162862 Sep 01 16:40:17.696614 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 410/822] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:17 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:18.714101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:18.714684 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:18.721420 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:18.721907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:18.722345 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:18.723054 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:18.723624 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:18.724080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:18.856546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:18.864442 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-af9fc33b-5dcb-41de-8991-b5a8e03d7d0b tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.154109 Sep 01 16:40:18.864967 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 413/823] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:18 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:19.886444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:19.887093 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:19.893747 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.894250 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.894673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:19.895394 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.895843 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.896259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.044385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:20.052139 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e2f4d01c-8ee9-43af-a7b0-b89e2856b659 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.169771 Sep 01 16:40:20.052712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 411/824] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:19 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:20.420935 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8f020146-0049-4b04-be1b-d2387dd1936f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:20.421480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8f020146-0049-4b04-be1b-d2387dd1936f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.427545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f020146-0049-4b04-be1b-d2387dd1936f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.427974 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f020146-0049-4b04-be1b-d2387dd1936f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.428836 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f020146-0049-4b04-be1b-d2387dd1936f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.429966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f020146-0049-4b04-be1b-d2387dd1936f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.430413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f020146-0049-4b04-be1b-d2387dd1936f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.430818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8f020146-0049-4b04-be1b-d2387dd1936f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.455255 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8f020146-0049-4b04-be1b-d2387dd1936f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61/ips" status: 200 len: 150 microversion: 2.1 time: 0.273697 Sep 01 16:40:20.455724 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 414/825] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:40:20 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61/ips => generated 150 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:20.467946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "965beab6-f9ca-4325-bd18-cddec1db5633"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:20.470443 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.476782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.477486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.477919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.478605 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.479050 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.479498 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.559713 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Invalid volume: volume 965beab6-f9ca-4325-bd18-cddec1db5633 is already attached to instances: dfd400b6-5c1a-4460-9cc0-275782d91b4a Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: POST /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61/os-volume_attachments HTTP/1.1 Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 74 Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:40:20.561693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {"volumeAttachment": {"volumeId": "965beab6-f9ca-4325-bd18-cddec1db5633"}} Sep 01 16:40:20.563351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Invalid volume: volume 965beab6-f9ca-4325-bd18-cddec1db5633 is already attached to instances: dfd400b6-5c1a-4460-9cc0-275782d91b4a Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'server_id': 'fc571669-74b7-49a8-b7db-1cdfd8b5fa61', 'body': {'volumeAttachment': {'volumeId': '965beab6-f9ca-4325-bd18-cddec1db5633'}}} Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 965beab6-f9ca-4325-bd18-cddec1db5633 is already attached to instances: dfd400b6-5c1a-4460-9cc0-275782d91b4a Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:20.564283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 965beab6-f9ca-4325-bd18-cddec1db5633 is already attached to instances: dfd400b6-5c1a-4460-9cc0-275782d91b4a Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:20.565752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:20.567130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:20.567130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:20.567130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:20.567130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 965beab6-f9ca-4325-bd18-cddec1db5633 is already attached to instances: dfd400b6-5c1a-4460-9cc0-275782d91b4a Sep 01 16:40:20.567130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:20.567130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 400 to user: Invalid volume: volume 965beab6-f9ca-4325-bd18-cddec1db5633 is already attached to instances: dfd400b6-5c1a-4460-9cc0-275782d91b4a {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:20.567130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3b126f2-b79d-4615-bb5a-d23eb9e6a3a8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099179 Sep 01 16:40:20.567130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 412/826] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:40:20 2022] POST /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:40:20.573468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:20.573959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.579969 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.580443 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.580866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.581821 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.582257 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.582666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.611745 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:20.947572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fecf68b4-48fc-483d-b15a-5646d20b3bb9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 204 len: 0 microversion: 2.1 time: 0.378744 Sep 01 16:40:20.948180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 415/827] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:20 2022] DELETE /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:40:20.956655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:20.957262 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.964802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.966705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.966705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.966705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.967024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.967339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.077089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:21.077796 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:21.084525 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.085014 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.085449 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.086188 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.086702 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.087070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.106408 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:21.114948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-93f71400-2c39-4d32-95d7-6bfa470263a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1680 microversion: 2.1 time: 0.162424 Sep 01 16:40:21.115584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 413/828] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:20 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:21.223669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:21.232043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2a03d392-8818-4a36-aba6-f5f7c607708a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.159327 Sep 01 16:40:21.232630 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 416/829] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:21 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:22.137872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:22.138574 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:22.145252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:22.145730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:22.146158 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.146984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:22.147465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:22.147883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.254252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:22.261915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:22.262855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:22.263384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:22.263816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.264508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:22.264954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:22.265368 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.292592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:22.300651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d219eea3-b882-43e5-bfdb-e0d1052d0794 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1680 microversion: 2.1 time: 0.166703 Sep 01 16:40:22.301299 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 414/830] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:22 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:22.409392 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:22.420437 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c34e5c35-d236-4f9f-8c96-26900785c090 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.170466 Sep 01 16:40:22.421026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 417/831] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:22 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:23.324421 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:23.325072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:23.333327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.334406 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.334406 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.335349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.336381 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.337125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.441945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:23.442545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:23.451434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.451925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.452377 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.453034 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.453629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.454054 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.565141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:23.574501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d119063e-0e7f-42a1-b0dc-754065cf8594 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1680 microversion: 2.1 time: 0.254203 Sep 01 16:40:23.575380 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 415/832] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:23 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:23.609195 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:23.617292 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d072895e-248f-4897-b034-23a72b6d7187 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.179163 Sep 01 16:40:23.618129 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 418/833] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:23 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:24.032602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-02a0dbf2-0daf-445d-b907-c17ff6511e12 req-67c95c8c-e454-44f5-b57c-4ed8f9bff94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc571669-74b7-49a8-b7db-1cdfd8b5fa61", "name": "network-vif-deleted", "tag": "c6b607d8-c6da-4e49-9ef6-25f87cbaa132"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:24.043333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-02a0dbf2-0daf-445d-b907-c17ff6511e12 req-67c95c8c-e454-44f5-b57c-4ed8f9bff94e service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.044505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-02a0dbf2-0daf-445d-b907-c17ff6511e12 req-67c95c8c-e454-44f5-b57c-4ed8f9bff94e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.044931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-02a0dbf2-0daf-445d-b907-c17ff6511e12 req-67c95c8c-e454-44f5-b57c-4ed8f9bff94e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.057825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-02a0dbf2-0daf-445d-b907-c17ff6511e12 req-67c95c8c-e454-44f5-b57c-4ed8f9bff94e service nova] Creating event network-vif-deleted:c6b607d8-c6da-4e49-9ef6-25f87cbaa132 for instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 on hv-cinder-83602 Sep 01 16:40:24.063034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-02a0dbf2-0daf-445d-b907-c17ff6511e12 req-67c95c8c-e454-44f5-b57c-4ed8f9bff94e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035679 Sep 01 16:40:24.063765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 416/834] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:24.596414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:24.597312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:24.604643 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.605828 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.610460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.611240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.611719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.612483 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.644587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:24.646010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:24.654219 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.654780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.655323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.656263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.656937 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.657597 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.691766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.692349 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.693040 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.693554 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lazy-loading 'fault' on Instance uuid fc571669-74b7-49a8-b7db-1cdfd8b5fa61 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:24.749784 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:24.762696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-41ae9a9a-b48f-4738-8389-16e70797bbda tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 200 len: 1330 microversion: 2.1 time: 0.170052 Sep 01 16:40:24.763303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 419/835] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:24 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 1330 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:24.817219 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:24.826153 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9847a1f0-9b48-4804-a9b7-971cf27cef13 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.186322 Sep 01 16:40:24.826904 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 417/836] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:24 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:25.784462 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:25.785204 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:25.792158 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.792652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.793114 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.793819 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.794276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.794699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.808586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 HTTP/1.1 Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:40:25.810241 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:40:25.811839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'fc571669-74b7-49a8-b7db-1cdfd8b5fa61'} Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:25.812719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:40:25.814309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:40:25.819099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:25.819099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9babf09e-06ba-45ed-a562-aeef81fc795c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 404 len: 111 microversion: 2.1 time: 0.031200 Sep 01 16:40:25.819099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 420/837] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:25 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:25.826174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7e7d494e-302a-47a9-882e-696e2e1dfa92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '.version_select at 0x7fe37d78e160>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:25.847968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:25.848577 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:25.854937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.855450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.855885 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.856580 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:25.857033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:25.857455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:25.901851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7e7d494e-302a-47a9-882e-696e2e1dfa92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248271050" status: 202 len: 0 microversion: 2.1 time: 0.079237 Sep 01 16:40:25.902447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 418/838] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 1 16:40:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248271050 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:26.019086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:26.030244 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-19040c60-f49f-48fe-9c3d-e9f2e4cfb9e4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1678 microversion: 2.1 time: 0.186090 Sep 01 16:40:26.031125 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 421/839] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:25 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:26.745465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:26.745965 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:26.753590 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.754075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.754517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.755271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.755724 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.756141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.853405 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lazy-loading 'services' on Instance uuid dfd400b6-5c1a-4460-9cc0-275782d91b4a {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:27.052343 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:27.053074 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:27.060339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.060825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.061299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.062028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.062481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.062904 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.069422 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-48fcee1f-55d3-428e-bc68-7eed751f7632 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments/965beab6-f9ca-4325-bd18-cddec1db5633" status: 202 len: 0 microversion: 2.1 time: 0.327750 Sep 01 16:40:27.070799 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 419/840] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:40:26 2022] DELETE /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments/965beab6-f9ca-4325-bd18-cddec1db5633 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:27.079738 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-93ab0029-7fbb-4492-a5b2-57ccfc52f2f8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:27.083231 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-93ab0029-7fbb-4492-a5b2-57ccfc52f2f8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:27.090249 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93ab0029-7fbb-4492-a5b2-57ccfc52f2f8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.090738 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93ab0029-7fbb-4492-a5b2-57ccfc52f2f8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.091194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93ab0029-7fbb-4492-a5b2-57ccfc52f2f8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.091898 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93ab0029-7fbb-4492-a5b2-57ccfc52f2f8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.092338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93ab0029-7fbb-4492-a5b2-57ccfc52f2f8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.092757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93ab0029-7fbb-4492-a5b2-57ccfc52f2f8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.125624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-93ab0029-7fbb-4492-a5b2-57ccfc52f2f8 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050163 Sep 01 16:40:27.126402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 420/841] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:27 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:27.209355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:27.217385 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9f372faf-e6ee-454f-b355-71664cfc41ce tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1655 microversion: 2.1 time: 0.168930 Sep 01 16:40:27.217988 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 422/842] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:27 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:27.238930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e0e48c1d-cb7b-48f5-af0d-743210fac4fb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:27.245935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e0e48c1d-cb7b-48f5-af0d-743210fac4fb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.252096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e0e48c1d-cb7b-48f5-af0d-743210fac4fb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.252096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e0e48c1d-cb7b-48f5-af0d-743210fac4fb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.274857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e0e48c1d-cb7b-48f5-af0d-743210fac4fb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Going to try to start instance {{(pid=127531) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 16:40:27.375488 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:27.455435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e0e48c1d-cb7b-48f5-af0d-743210fac4fb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/action" status: 202 len: 0 microversion: 2.1 time: 0.219882 Sep 01 16:40:27.456269 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 421/843] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:40:27 2022] POST /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:27.466825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:27.467474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:27.473572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.474049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.474477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.475193 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.475791 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.476234 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.496944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:27.613091 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:27.621069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c7436c9e-b950-47f8-9ac1-28f04005f85d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1664 microversion: 2.1 time: 0.158943 Sep 01 16:40:27.621640 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 423/844] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:27 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:28.158348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d14725c4-34ea-41bb-ab42-fbdf524575cf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:28.158348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d14725c4-34ea-41bb-ab42-fbdf524575cf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:28.158348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d14725c4-34ea-41bb-ab42-fbdf524575cf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.158348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d14725c4-34ea-41bb-ab42-fbdf524575cf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.159336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d14725c4-34ea-41bb-ab42-fbdf524575cf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.159336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d14725c4-34ea-41bb-ab42-fbdf524575cf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.159336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d14725c4-34ea-41bb-ab42-fbdf524575cf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.159336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d14725c4-34ea-41bb-ab42-fbdf524575cf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.192906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d14725c4-34ea-41bb-ab42-fbdf524575cf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056806 Sep 01 16:40:28.193498 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 422/845] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:28 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:28.642114 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:28.642748 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:28.649428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.649969 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.650331 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.651024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.651497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.652485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.793575 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:28.802011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8487e457-3de9-4a70-94e7-ca8951bc41d4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1664 microversion: 2.1 time: 0.163696 Sep 01 16:40:28.802597 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 424/846] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:28 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:29.205553 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d03c6331-1e88-4265-8c8c-0af917dc8a0d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.208821 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d03c6331-1e88-4265-8c8c-0af917dc8a0d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.216264 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d03c6331-1e88-4265-8c8c-0af917dc8a0d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.216723 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d03c6331-1e88-4265-8c8c-0af917dc8a0d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.217156 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d03c6331-1e88-4265-8c8c-0af917dc8a0d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.217869 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d03c6331-1e88-4265-8c8c-0af917dc8a0d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.218320 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d03c6331-1e88-4265-8c8c-0af917dc8a0d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.218739 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d03c6331-1e88-4265-8c8c-0af917dc8a0d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.248435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d03c6331-1e88-4265-8c8c-0af917dc8a0d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046899 Sep 01 16:40:29.249000 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 423/847] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:40:29.311026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.311555 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.317585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.318038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.318502 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.319218 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.319672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.320097 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.346657 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:29.686427 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-02a24127-c07a-4895-b7cf-51d82413765b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 204 len: 0 microversion: 2.1 time: 0.379037 Sep 01 16:40:29.687097 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 425/848] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:29 2022] DELETE /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:29.696016 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.696638 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.702715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.703241 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.703691 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.704448 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.704902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.705326 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.828281 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.829214 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.835633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.836286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.836836 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.837442 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.838007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.838425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.844631 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:29.852766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4ccc72c0-0b0d-4383-954e-4b7921455dbe tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1682 microversion: 2.1 time: 0.161228 Sep 01 16:40:29.853614 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 424/849] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:29.979724 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:29.987467 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f831a7a9-825b-4030-9230-346eb6ad73fe tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1668 microversion: 2.1 time: 0.163419 Sep 01 16:40:29.988242 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 426/850] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:30.874494 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:30.875029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:30.881788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.882270 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.883420 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.884289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.884776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.885205 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.024709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:31.032876 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-239fd75e-5b57-4bf5-a618-a22f26b26b25 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1682 microversion: 2.1 time: 0.162308 Sep 01 16:40:31.033456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 425/851] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:30 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:32.053835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:32.054426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:32.062441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.062957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.063424 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.064132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.064588 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.065008 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.147128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:32.160564 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-03a4834b-4017-4623-a002-ea949bfb5847 req-549ee68d-3325-4770-a998-e7fde1d22406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd400b6-5c1a-4460-9cc0-275782d91b4a", "name": "network-vif-deleted", "tag": "ac74679f-5302-4fd4-945b-001fa0f572f7"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:32.161873 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9564c1b9-6586-4826-b71c-511b3ffdf5a0 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1615 microversion: 2.1 time: 0.111719 Sep 01 16:40:32.162815 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 427/852] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:32 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1615 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:32.172792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-03a4834b-4017-4623-a002-ea949bfb5847 req-549ee68d-3325-4770-a998-e7fde1d22406 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.173376 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-03a4834b-4017-4623-a002-ea949bfb5847 req-549ee68d-3325-4770-a998-e7fde1d22406 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.173867 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-03a4834b-4017-4623-a002-ea949bfb5847 req-549ee68d-3325-4770-a998-e7fde1d22406 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.189203 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-03a4834b-4017-4623-a002-ea949bfb5847 req-549ee68d-3325-4770-a998-e7fde1d22406 service nova] Creating event network-vif-deleted:ac74679f-5302-4fd4-945b-001fa0f572f7 for instance dfd400b6-5c1a-4460-9cc0-275782d91b4a on hv-cinder-83602 Sep 01 16:40:32.196619 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-03a4834b-4017-4623-a002-ea949bfb5847 req-549ee68d-3325-4770-a998-e7fde1d22406 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040589 Sep 01 16:40:32.197918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 426/853] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:33.184512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:33.185304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:33.193741 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:33.194520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:33.195057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:33.196372 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:33.196862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:33.197283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:33.231286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:33.231702 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:33.232134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:33.232577 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lazy-loading 'fault' on Instance uuid dfd400b6-5c1a-4460-9cc0-275782d91b4a {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:33.275519 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:33.286305 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3ac673f4-72ce-4277-9805-7917c2d1f23e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 200 len: 1332 microversion: 2.1 time: 0.106123 Sep 01 16:40:33.287501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 428/854] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:33 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:34.311128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:34.311858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:34.318490 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.318991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.319429 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.320118 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.321153 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.321595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.335593 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a HTTP/1.1 Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:40:34.338204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:40:34.339624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'dfd400b6-5c1a-4460-9cc0-275782d91b4a'} Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:34.340471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:40:34.341990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:34.343359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:34.343359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-955baade-fc42-4026-87d5-5844e6b245af tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 404 len: 111 microversion: 2.1 time: 0.032753 Sep 01 16:40:34.343359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 427/855] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:34 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:34.348516 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-25b45d89-ec6b-465d-bbc4-8e097d37c6c9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '.version_select at 0x7fe37d85fb80>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:34.424719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-25b45d89-ec6b-465d-bbc4-8e097d37c6c9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417858930" status: 202 len: 0 microversion: 2.1 time: 0.079866 Sep 01 16:40:34.425330 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 429/856] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 1 16:40:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417858930 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:34.655561 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fe2383ac-a4b6-4d9e-9e52-78c15b646c97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:34.656049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fe2383ac-a4b6-4d9e-9e52-78c15b646c97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:34.662483 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe2383ac-a4b6-4d9e-9e52-78c15b646c97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.662976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe2383ac-a4b6-4d9e-9e52-78c15b646c97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.663444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe2383ac-a4b6-4d9e-9e52-78c15b646c97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.667205 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe2383ac-a4b6-4d9e-9e52-78c15b646c97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.667205 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe2383ac-a4b6-4d9e-9e52-78c15b646c97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.667205 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe2383ac-a4b6-4d9e-9e52-78c15b646c97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.702718 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fe2383ac-a4b6-4d9e-9e52-78c15b646c97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments/7dec31cf-4021-4bf6-89d0-f5052c8089a0" status: 200 len: 194 microversion: 2.20 time: 0.051184 Sep 01 16:40:34.703662 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 428/857] 10.222.0.16 () {60 vars in 1454 bytes} [Thu Sep 1 16:40:34 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments/7dec31cf-4021-4bf6-89d0-f5052c8089a0 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:40:34.772207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:34.772709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:34.779413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.779827 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.780258 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.780949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.781400 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.781824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.874434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lazy-loading 'services' on Instance uuid aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:35.114925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-49d84bd6-d616-4c49-b68a-cfa95030b036 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments/7dec31cf-4021-4bf6-89d0-f5052c8089a0" status: 202 len: 0 microversion: 2.20 time: 0.346375 Sep 01 16:40:35.115482 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 430/858] 10.222.0.16 () {60 vars in 1457 bytes} [Thu Sep 1 16:40:34 2022] DELETE /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments/7dec31cf-4021-4bf6-89d0-f5052c8089a0 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:35.124777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-82113139-d68b-4c59-835f-9b794981aba1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:35.126941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-82113139-d68b-4c59-835f-9b794981aba1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:35.133999 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82113139-d68b-4c59-835f-9b794981aba1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.134804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82113139-d68b-4c59-835f-9b794981aba1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.135088 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82113139-d68b-4c59-835f-9b794981aba1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.135845 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82113139-d68b-4c59-835f-9b794981aba1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.136275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82113139-d68b-4c59-835f-9b794981aba1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.136692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-82113139-d68b-4c59-835f-9b794981aba1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.169618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-82113139-d68b-4c59-835f-9b794981aba1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049003 Sep 01 16:40:35.170190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 429/859] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 1 16:40:35 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:40:35.221848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bf4ae741-7bf0-4aa1-bd38-5eb39ff1fcac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: .version_select at 0x7fe379fba3a0>, body: {"keypair": {"name": "tempest-keypair-1820463469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSiNHyoZDNlFARX9b75x8Fn81l8+jCemBqO42cQaWOBPJEwjqoTiPUEj4cBjulPoTqc9uqZ/aSg9xV06eKrRtSeok9LLFd6XbjIzgOCbAhPPDqfg5Ib+1tIC7QLVuPJdA=="}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:35.237671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-bf4ae741-7bf0-4aa1-bd38-5eb39ff1fcac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for project a994270b8e1f43328b827696f9d89bb0. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:35.241588 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-bf4ae741-7bf0-4aa1-bd38-5eb39ff1fcac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for user 8a45ee95cf5947c49584ff403facaff7 and project a994270b8e1f43328b827696f9d89bb0. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:35.372201 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bf4ae741-7bf0-4aa1-bd38-5eb39ff1fcac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154770 Sep 01 16:40:35.372901 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 431/860] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:40:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:36.184396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ab70c627-2a19-4c14-9aba-b3c5a02a5242 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:36.186695 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ab70c627-2a19-4c14-9aba-b3c5a02a5242 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:36.193595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab70c627-2a19-4c14-9aba-b3c5a02a5242 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:36.194083 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab70c627-2a19-4c14-9aba-b3c5a02a5242 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:36.194524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab70c627-2a19-4c14-9aba-b3c5a02a5242 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:36.196226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab70c627-2a19-4c14-9aba-b3c5a02a5242 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:36.196226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab70c627-2a19-4c14-9aba-b3c5a02a5242 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:36.196551 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab70c627-2a19-4c14-9aba-b3c5a02a5242 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:36.230976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ab70c627-2a19-4c14-9aba-b3c5a02a5242 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051579 Sep 01 16:40:36.231581 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 430/861] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 1 16:40:36 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:40:37.244678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f7cccbeb-3e92-4808-b898-6795b2ed430c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:37.246889 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f7cccbeb-3e92-4808-b898-6795b2ed430c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:37.254116 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7cccbeb-3e92-4808-b898-6795b2ed430c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.254596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7cccbeb-3e92-4808-b898-6795b2ed430c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.255018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7cccbeb-3e92-4808-b898-6795b2ed430c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.255749 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7cccbeb-3e92-4808-b898-6795b2ed430c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.256194 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7cccbeb-3e92-4808-b898-6795b2ed430c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.256618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f7cccbeb-3e92-4808-b898-6795b2ed430c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.288512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f7cccbeb-3e92-4808-b898-6795b2ed430c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048616 Sep 01 16:40:37.289209 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 432/862] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 1 16:40:37 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:37.354472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:37.355047 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:37.361710 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.362200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.362631 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.363357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.363974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.364358 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.397823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:37.668085 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-383aa825-29b5-4e80-872b-aa7dc02f18d2 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 204 len: 0 microversion: 2.20 time: 0.317729 Sep 01 16:40:37.669351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 431/863] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 1 16:40:37 2022] DELETE /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:40:37.677666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:37.678351 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:37.685226 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.686994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.687552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.688267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.688732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.689156 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.697410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2134238665", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1eb71281-5889-42b9-a660-ae574bf041ed"}], "security_groups": [{"name": "tempest-securitygroup--81765124"}], "key_name": "tempest-keypair-1820463469", "user_data": "}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:37.809686 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] validate_networks() for [('1eb71281-5889-42b9-a660-ae574bf041ed', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:40:37.831493 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.840677 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.842111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.843395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-609b505b-bf57-4fb2-9f73-1e4e8df15524 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.169555 Sep 01 16:40:37.843955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 433/864] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:37 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:37.995430 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:38.191779 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:40:38.192196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:40:38.192756 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:40:38.193158 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:40:38.193589 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:40:38.203816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.204292 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.204725 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.205441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.205884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.206298 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.224310 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for project a994270b8e1f43328b827696f9d89bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:38.229007 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for user 8a45ee95cf5947c49584ff403facaff7 and project a994270b8e1f43328b827696f9d89bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:38.240690 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:40:38.243889 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:40:38.379176 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eed70b57-2b50-4788-973f-474a24d07743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.686659 Sep 01 16:40:38.379824 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 432/865] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:40:37 2022] POST /compute/v2.1/servers => generated 400 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:40:38.391176 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ec4e48f1-0042-4540-b135-7584951088fa tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:38.391759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ec4e48f1-0042-4540-b135-7584951088fa tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:38.447323 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ec4e48f1-0042-4540-b135-7584951088fa tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:38.454331 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ec4e48f1-0042-4540-b135-7584951088fa tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1242 microversion: 2.1 time: 0.066911 Sep 01 16:40:38.455082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 434/866] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:38 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:38.868327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:38.868991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:38.875926 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.876407 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.876841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.877539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.878036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.878465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:39.020985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.029751 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.031211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.032370 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-91c03389-ca57-442e-8710-0c6be8bf4d1f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.168666 Sep 01 16:40:39.032925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 433/867] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:38 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:39.476113 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:39.477418 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:39.485646 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:39.486131 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:39.489328 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:39.489328 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:39.489328 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:39.489328 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:39.556900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.564489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c11a9a8d-41e9-4552-995a-0c5e92f163c3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1246 microversion: 2.1 time: 0.092205 Sep 01 16:40:39.565077 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 435/868] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:39 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:40.055066 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:40.055728 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:40.062408 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:40.062896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:40.063355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:40.064086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:40.064535 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:40.064973 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:40.288156 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.299035 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.300493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.301655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d8f17a66-35ea-4afe-bbd5-b95fffca259b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1722 microversion: 2.20 time: 0.250634 Sep 01 16:40:40.302380 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 434/869] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:40 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:40.585510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:40.586127 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:40.588777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:40.593747 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:40.594243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:40.594711 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:40.595466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:40.596207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:40.597157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:40.667581 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.675413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ee42114a-fdc3-4089-a8b5-d7a2b0f4b29b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1294 microversion: 2.1 time: 0.094062 Sep 01 16:40:40.675997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 436/870] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:40 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:41.083855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-26ae156c-eb0a-4733-95ef-6286e405fd42 req-6ec0f2e9-ef1b-4468-95a9-49434fd93886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f", "name": "network-vif-deleted", "tag": "7528df97-c3e6-4a5e-8a1c-e62df28e6f83"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:41.096038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-26ae156c-eb0a-4733-95ef-6286e405fd42 req-6ec0f2e9-ef1b-4468-95a9-49434fd93886 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.096525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-26ae156c-eb0a-4733-95ef-6286e405fd42 req-6ec0f2e9-ef1b-4468-95a9-49434fd93886 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.096955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-26ae156c-eb0a-4733-95ef-6286e405fd42 req-6ec0f2e9-ef1b-4468-95a9-49434fd93886 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.111050 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-26ae156c-eb0a-4733-95ef-6286e405fd42 req-6ec0f2e9-ef1b-4468-95a9-49434fd93886 service nova] Creating event network-vif-deleted:7528df97-c3e6-4a5e-8a1c-e62df28e6f83 for instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f on hv-cinder-83602 Sep 01 16:40:41.118454 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-26ae156c-eb0a-4733-95ef-6286e405fd42 req-6ec0f2e9-ef1b-4468-95a9-49434fd93886 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037700 Sep 01 16:40:41.119380 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 435/871] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:41.326777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:41.327436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:41.337609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.338104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.338539 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.339296 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.339750 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.340173 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.432375 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.443616 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.445968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.446851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-598af15b-08f7-4463-afc3-3b73959bc955 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1366 microversion: 2.20 time: 0.124104 Sep 01 16:40:41.447458 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 437/872] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:41 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:41.698616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:41.699275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:41.705813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.720024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.720024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.720024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.720024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.721386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.779255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.788569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8722ab45-15ae-4822-aa15-487c1c1999c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1300 microversion: 2.1 time: 0.094933 Sep 01 16:40:41.792663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 436/873] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:41 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:42.477713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.477713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.483949 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.484411 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.485067 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.486138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.486594 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.487020 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.529115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.529681 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.530112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.530559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lazy-loading 'fault' on Instance uuid aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:42.580401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.589926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.592652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.593477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6f94b128-0d82-4537-8472-13dc9d863b32 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 200 len: 1371 microversion: 2.20 time: 0.122549 Sep 01 16:40:42.594442 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 438/874] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:42 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:42.810599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.811285 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.817796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.818277 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.818701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.819408 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.819853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.820267 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.957667 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.973357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-198fca55-d93c-4320-9f7c-ff78cb1f5d5b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.166473 Sep 01 16:40:42.974126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 437/875] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:42 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:43.177050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-c1c39576-a476-4210-9b7a-7c0f7627d87b req-12e13c9f-c35c-427f-afad-aed013b7ad60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d5141e-06e1-45b2-ad7a-11ae9de1a0bf", "tag": "1f17da61-a2b1-4c49-b455-712316c7f8c4"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:43.184785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-c1c39576-a476-4210-9b7a-7c0f7627d87b req-12e13c9f-c35c-427f-afad-aed013b7ad60 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:43.185254 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-c1c39576-a476-4210-9b7a-7c0f7627d87b req-12e13c9f-c35c-427f-afad-aed013b7ad60 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:43.185678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-c1c39576-a476-4210-9b7a-7c0f7627d87b req-12e13c9f-c35c-427f-afad-aed013b7ad60 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:43.197687 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-c1c39576-a476-4210-9b7a-7c0f7627d87b req-12e13c9f-c35c-427f-afad-aed013b7ad60 service nova] Creating event network-changed:1f17da61-a2b1-4c49-b455-712316c7f8c4 for instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf on hv-cinder-83602 Sep 01 16:40:43.202511 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-c1c39576-a476-4210-9b7a-7c0f7627d87b req-12e13c9f-c35c-427f-afad-aed013b7ad60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031620 Sep 01 16:40:43.203247 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 439/876] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:43.622914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:43.623572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:43.629509 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:43.629989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:43.630420 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:43.631104 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:43.631575 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:43.631992 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:43.646851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] HTTP exception thrown: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Request method failure captured: Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f HTTP/1.1 Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7FIe7N8EMhgjpULOxJK4YaiEv4LW3SkHHa7SoCXEu4nIfyEZKU110N6VzyL18zGsgr3Vi6gPUEftHgpEM1gEO8o4IrrmjUP8goDk8uOpU7x-kvfr5_lXpHMsoC2ytTjCKaiHaw81MK_GVmsWcRCl-Q8Ydl84qIIEwuNZ45YM9-OWM Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:40:43.649070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b14e9793530a41bbab5bd4b3caecdb3c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: ab4df1724851433889a519583a5333b3 Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:40:43.651935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f'} Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:43.653418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:40:43.655353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:40:43.656948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Returning 404 to user: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:43.656948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a51cdff3-0a1f-4d7f-925c-4a9a0e43256a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 404 len: 111 microversion: 2.20 time: 0.032214 Sep 01 16:40:43.656948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 438/877] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:43 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:40:43.661887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bafdabdf-54ef-419c-b9f9-c42b42565e4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '.version_select at 0x7fe37a0a6940>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:43.738431 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bafdabdf-54ef-419c-b9f9-c42b42565e4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062091439" status: 204 len: 0 microversion: 2.20 time: 0.081744 Sep 01 16:40:43.739218 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 440/878] 10.222.0.16 () {60 vars in 1262 bytes} [Thu Sep 1 16:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062091439 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:40:43.995255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:43.996452 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:44.005042 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.006442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.007112 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.017150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.017150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.017150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.252929 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.264463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-25d50084-4673-4fc7-8ed6-ef2637e034a5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.273689 Sep 01 16:40:44.265073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 439/879] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:43 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:44.887850 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-76c7e9ab-c47e-419b-a13a-94d52781efb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'create', calling method: .version_select at 0x7fe37d7f68b0>, body: {"keypair": {"name": "tempest-keypair-1179711177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTp0uInNJmViCwxNftUpi9CSpyoxXydd4EEaHmesYGJd2QRal2sp6KoFEFxc9O2TqbdVIEcrWt2GM5acvzsm1PojvmHT4kycWtC20e/nfBOhTZyAQmoXcRn8N2ZvTzA3w=="}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:44.904407 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-76c7e9ab-c47e-419b-a13a-94d52781efb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Getting quotas for project b14e9793530a41bbab5bd4b3caecdb3c. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:44.908163 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-76c7e9ab-c47e-419b-a13a-94d52781efb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Getting quotas for user ab4df1724851433889a519583a5333b3 and project b14e9793530a41bbab5bd4b3caecdb3c. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:44.991042 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-76c7e9ab-c47e-419b-a13a-94d52781efb3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.108611 Sep 01 16:40:44.991726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 441/880] 10.222.0.16 () {62 vars in 1200 bytes} [Thu Sep 1 16:40:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 16:40:45.286146 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:45.286771 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:45.294219 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.294703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.295129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.295853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.296296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.296704 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.302130 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:45.441595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.450318 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-621993f2-80f1-41ac-8062-5e76099623c6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.167974 Sep 01 16:40:45.450826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 440/881] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:45 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:46.472178 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:46.472905 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:46.479730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.480476 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.480898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.481600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.482050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.482464 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.625266 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.629035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:46.634925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8ef01d7b-6cf4-4888-b818-a854ea652950 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.166925 Sep 01 16:40:46.636778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 442/882] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:46 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:47.454925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-873257008", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c77ef22c-addf-4317-8f69-06a58732469c"}], "security_groups": [{"name": "tempest-securitygroup--1638977730"}], "key_name": "tempest-keypair-1179711177", "user_data": "}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:47.564063 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] validate_networks() for [('c77ef22c-addf-4317-8f69-06a58732469c', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:40:47.657828 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:47.658523 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:47.666107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.667473 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.667914 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.668652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.669104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.669604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.814023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:47.822550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7c11181f-cbf3-49d6-88d8-7e1877142678 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.168937 Sep 01 16:40:47.823141 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 443/883] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:47 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:47.971098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:40:47.974402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:40:47.974402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:40:47.974402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:40:47.974402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:40:47.982163 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.982638 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.983065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.983813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.984257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.984673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:48.004237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Getting quotas for project b14e9793530a41bbab5bd4b3caecdb3c. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:48.012357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Getting quotas for user ab4df1724851433889a519583a5333b3 and project b14e9793530a41bbab5bd4b3caecdb3c. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:48.023805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:40:48.026550 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:40:48.157970 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c531c755-9ef9-4383-bba7-4a94bf1b24c6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.707333 Sep 01 16:40:48.158850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 441/884] 10.222.0.16 () {62 vars in 1188 bytes} [Thu Sep 1 16:40:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 16:40:48.170201 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-24280855-5a16-4600-b729-e9a3253b3f18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:48.170838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-24280855-5a16-4600-b729-e9a3253b3f18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:48.237022 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-24280855-5a16-4600-b729-e9a3253b3f18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.250470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-24280855-5a16-4600-b729-e9a3253b3f18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.254014 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-24280855-5a16-4600-b729-e9a3253b3f18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.256502 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-24280855-5a16-4600-b729-e9a3253b3f18 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1281 microversion: 2.20 time: 0.089153 Sep 01 16:40:48.257480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 444/885] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:48 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:48.844171 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:48.844779 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:48.853590 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:48.854074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:48.854509 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:48.855232 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:48.855686 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:48.856236 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:48.990709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.999209 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-894a1acb-5732-40cc-9b43-849a09ac1e80 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.159338 Sep 01 16:40:48.999802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 442/886] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:48 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:49.193250 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:49.193846 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:49.201046 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.201521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.201947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.202640 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.203081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.203520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.281836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:49.282203 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:49.292538 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lazy-loading 'services' on Instance uuid db6a9ac9-616c-4e7b-a0f8-f37ba164254a {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:49.293857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.294345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.294777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.295500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.295949 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.296372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.364701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:49.373317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:49.375708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:49.375954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-78cce0f8-5e44-49dd-9f81-bd6df76a6b6c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1285 microversion: 2.20 time: 0.098451 Sep 01 16:40:49.376512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 443/887] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:49 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:49.515055 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5d3e15c6-28c2-4898-a935-46a0264cba30 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments/3fe42d15-d9f5-4a78-b485-c35674366742" status: 202 len: 0 microversion: 2.1 time: 0.325448 Sep 01 16:40:49.515609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 445/888] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:40:49 2022] DELETE /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments/3fe42d15-d9f5-4a78-b485-c35674366742 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:49.524948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4a5abdd9-a80e-4651-84ac-d77a22d4225b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:49.527335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4a5abdd9-a80e-4651-84ac-d77a22d4225b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:49.533517 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4a5abdd9-a80e-4651-84ac-d77a22d4225b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.534002 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4a5abdd9-a80e-4651-84ac-d77a22d4225b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.534431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4a5abdd9-a80e-4651-84ac-d77a22d4225b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.535509 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4a5abdd9-a80e-4651-84ac-d77a22d4225b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.536026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4a5abdd9-a80e-4651-84ac-d77a22d4225b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.536452 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4a5abdd9-a80e-4651-84ac-d77a22d4225b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.568335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4a5abdd9-a80e-4651-84ac-d77a22d4225b tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048150 Sep 01 16:40:49.568906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 444/889] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:49 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:50.021282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:50.022010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:50.028864 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.029346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.029776 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.030469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.030915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.031365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.174137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.182687 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a6e1361f-a6e0-4196-af1e-cf3c4e4094b5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.165570 Sep 01 16:40:50.183365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 446/890] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:50 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:50.406964 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:50.407839 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:50.424837 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.425334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.425780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.426682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.427255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.435397 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.476855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-759c1396-9320-4f0a-963d-a708c4360807 req-90f24d3a-fa29-4f4d-860d-d707337a7928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d5141e-06e1-45b2-ad7a-11ae9de1a0bf", "name": "network-vif-plugged", "status": "completed", "tag": "1f17da61-a2b1-4c49-b455-712316c7f8c4"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:50.488119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-759c1396-9320-4f0a-963d-a708c4360807 req-90f24d3a-fa29-4f4d-860d-d707337a7928 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.488918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-759c1396-9320-4f0a-963d-a708c4360807 req-90f24d3a-fa29-4f4d-860d-d707337a7928 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.489472 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-759c1396-9320-4f0a-963d-a708c4360807 req-90f24d3a-fa29-4f4d-860d-d707337a7928 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.504013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-759c1396-9320-4f0a-963d-a708c4360807 req-90f24d3a-fa29-4f4d-860d-d707337a7928 service nova] Creating event network-vif-plugged:1f17da61-a2b1-4c49-b455-712316c7f8c4 for instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf on hv-cinder-83602 Sep 01 16:40:50.509772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-759c1396-9320-4f0a-963d-a708c4360807 req-90f24d3a-fa29-4f4d-860d-d707337a7928 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036954 Sep 01 16:40:50.510884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 447/891] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:50.512212 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.521047 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.522612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.524840 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e7b7592f-5d72-4f71-9d50-19bc93ece8bf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1333 microversion: 2.20 time: 0.121140 Sep 01 16:40:50.525392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 445/892] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:50 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:50.582088 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3709ba46-b30a-4d11-8b1d-e28a1e803977 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:50.585946 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3709ba46-b30a-4d11-8b1d-e28a1e803977 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:50.609909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3709ba46-b30a-4d11-8b1d-e28a1e803977 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.610459 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3709ba46-b30a-4d11-8b1d-e28a1e803977 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.610892 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3709ba46-b30a-4d11-8b1d-e28a1e803977 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.611618 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3709ba46-b30a-4d11-8b1d-e28a1e803977 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.612069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3709ba46-b30a-4d11-8b1d-e28a1e803977 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.612489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3709ba46-b30a-4d11-8b1d-e28a1e803977 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.815775 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3709ba46-b30a-4d11-8b1d-e28a1e803977 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238690 Sep 01 16:40:50.820491 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 448/893] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:50 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:51.204876 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:51.205350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:51.212836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.213323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.213757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.214454 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.215117 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.215569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.351275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.359548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ffde8840-3c5c-4f6f-9a09-eb2e6d41578b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.158612 Sep 01 16:40:51.360126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 446/894] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:51 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:51.548566 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:51.549175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:51.556498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.556985 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.557417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.558102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.558545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.558959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.624089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.632392 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.634518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.635653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0acf66b6-fb33-4fd3-9c62-a1ce823c1edf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1341 microversion: 2.20 time: 0.091019 Sep 01 16:40:51.636204 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 449/895] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:51 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:51.828500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1357d040-b1ce-4214-a28f-18539a4403e0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:51.830714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1357d040-b1ce-4214-a28f-18539a4403e0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:51.837349 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1357d040-b1ce-4214-a28f-18539a4403e0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.837841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1357d040-b1ce-4214-a28f-18539a4403e0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.838280 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1357d040-b1ce-4214-a28f-18539a4403e0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.839004 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1357d040-b1ce-4214-a28f-18539a4403e0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.839484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1357d040-b1ce-4214-a28f-18539a4403e0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.839909 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1357d040-b1ce-4214-a28f-18539a4403e0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.870807 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1357d040-b1ce-4214-a28f-18539a4403e0 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046457 Sep 01 16:40:51.871423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 447/896] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:51 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:40:51.956670 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:51.957170 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:51.964276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.964763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.965195 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.965901 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.966356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.966794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.992265 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:52.310094 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3853109c-fc35-43b6-ba1c-26dfd0e7946c tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 204 len: 0 microversion: 2.1 time: 0.357231 Sep 01 16:40:52.310677 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 450/897] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:51 2022] DELETE /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:52.318813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:52.319453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:52.326272 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.326856 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.329312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.329312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.329312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.329312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.381205 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:52.381816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:52.388888 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.389372 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.389829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.390530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.390981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.391438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.467433 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.478334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cbd803c8-c01e-4f4a-a338-5fec86bd1648 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1691 microversion: 2.1 time: 0.162810 Sep 01 16:40:52.490255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 448/898] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:52 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:52.637143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.645930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-86739f49-bddd-4d1f-bb57-0e63912de95d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.268946 Sep 01 16:40:52.646513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 451/899] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:52 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:52.659742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:52.660501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:52.668410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.671954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.671954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.671954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.671954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.672343 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.740776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.750210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.751816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.752964 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-81b278a5-391c-4bfe-bcb1-4282c4707525 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1351 microversion: 2.20 time: 0.097526 Sep 01 16:40:52.753515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 449/900] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:52 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:53.502087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:53.502700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:53.511694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.512182 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.512612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.513319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.513764 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.514180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.651383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.659426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d8fa2bb9-a002-4d90-9d9b-b2deb4aca8a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1691 microversion: 2.1 time: 0.161138 Sep 01 16:40:53.659991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 452/901] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:53 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:53.667217 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:53.667864 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:53.674648 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.675134 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.675608 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.676304 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.676761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.677181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.777046 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:53.777674 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:53.783792 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.784276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.784703 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.785405 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.785850 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.786309 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.821501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.829658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7c947435-802b-45a7-ba83-699c4b5d8486 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.166423 Sep 01 16:40:53.830248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 450/902] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:53 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:53.929877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.937149 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.938590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.939743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-84564d0f-f925-438d-a4c9-1b35adbbee72 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1419 microversion: 2.20 time: 0.167606 Sep 01 16:40:53.940312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 453/903] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:53 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1419 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:54.681378 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:54.682347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:54.688582 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:54.689066 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:54.689508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:54.690179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:54.690619 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:54.691030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:54.850264 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:54.850881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:54.858107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:54.858591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:54.859021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:54.859749 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:54.860276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:54.860726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:54.983136 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:54.991116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-68c85ad1-68d6-41a2-ac10-779015d167a7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1691 microversion: 2.1 time: 0.313916 Sep 01 16:40:54.991791 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 451/904] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:54 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1691 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:54.996387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:54.996999 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:55.000087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:55.005848 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.006346 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.006781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.007520 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.007976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.008909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a755bd6d-8ae9-461c-b523-08841fcb8aae tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.161958 Sep 01 16:40:55.009165 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.009275 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 454/905] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:54 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:55.146598 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:55.155721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:55.157165 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:55.158260 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0d1f8452-bb58-42dc-8777-9cbd303da425 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1419 microversion: 2.20 time: 0.165559 Sep 01 16:40:55.158818 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 452/906] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:54 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1419 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:56.013279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:56.013853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:56.020381 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.020867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.021300 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.022001 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.022451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.024877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.030718 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:56.036764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:56.037956 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.038442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.038880 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.039604 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.040056 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.040477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.169875 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:56.174197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:56.178140 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4699c9df-864a-42fc-8b27-654a83e4d7ad tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1691 microversion: 2.1 time: 0.168816 Sep 01 16:40:56.178751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 455/907] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:56 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:56.183672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d76b40a5-06dc-44ae-a02b-a0debd176e44 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1366 microversion: 2.1 time: 0.157117 Sep 01 16:40:56.184243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 453/908] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:56 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:56.184403 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:56.184900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:56.190934 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.191441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.192118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.192816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.193270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.193685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.338712 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:56.347100 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:56.348562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:56.349679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e5ac3829-c3ab-4f88-829d-c976da8c66b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1419 microversion: 2.20 time: 0.169974 Sep 01 16:40:56.350236 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 456/909] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:56 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1419 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:57.201443 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:57.202039 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:57.204526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:57.205279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:57.208977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.209471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.209904 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.210606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.211140 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.212121 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.213114 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.213672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.214117 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.214833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.215333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.215922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.356779 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:57.365601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bee70ae5-b036-4224-8a6a-567dcf3ef1e4 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1691 microversion: 2.1 time: 0.167083 Sep 01 16:40:57.365601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 454/910] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:57 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:57.373404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:57.374658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:57.380788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.381279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.381716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.386079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.386079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.386079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.428015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:57.436989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5b74130d-4e56-4b1b-99c1-a32a833b1136 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1556 microversion: 2.1 time: 0.236463 Sep 01 16:40:57.443429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 457/911] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:57 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1556 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:57.458652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f91c8c46-36c3-4936-82ef-307df1b22066 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:57.459147 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f91c8c46-36c3-4936-82ef-307df1b22066 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:57.466081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f91c8c46-36c3-4936-82ef-307df1b22066 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.466563 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f91c8c46-36c3-4936-82ef-307df1b22066 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.466992 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f91c8c46-36c3-4936-82ef-307df1b22066 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.467722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f91c8c46-36c3-4936-82ef-307df1b22066 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.472317 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f91c8c46-36c3-4936-82ef-307df1b22066 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.472317 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f91c8c46-36c3-4936-82ef-307df1b22066 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.529345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:57.539963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:57.542250 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:57.543440 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-21e43ddf-476f-4b69-8d94-41d0df233661 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1407 microversion: 2.20 time: 0.174417 Sep 01 16:40:57.544063 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 455/912] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:57 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:57.548795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-023a8d6f-9b94-421c-868e-f6e70c411e9f req-c882dd6c-94c8-4361-9c90-0f23c3d2c832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3", "tag": "611fe9aa-a99e-4482-9ba2-a177311f9a82"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:57.559926 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-023a8d6f-9b94-421c-868e-f6e70c411e9f req-c882dd6c-94c8-4361-9c90-0f23c3d2c832 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.560401 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-023a8d6f-9b94-421c-868e-f6e70c411e9f req-c882dd6c-94c8-4361-9c90-0f23c3d2c832 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.561182 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-023a8d6f-9b94-421c-868e-f6e70c411e9f req-c882dd6c-94c8-4361-9c90-0f23c3d2c832 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.573665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-023a8d6f-9b94-421c-868e-f6e70c411e9f req-c882dd6c-94c8-4361-9c90-0f23c3d2c832 service nova] Creating event network-changed:611fe9aa-a99e-4482-9ba2-a177311f9a82 for instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 on hv-cinder-83602 Sep 01 16:40:57.578842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-023a8d6f-9b94-421c-868e-f6e70c411e9f req-c882dd6c-94c8-4361-9c90-0f23c3d2c832 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033503 Sep 01 16:40:57.579482 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 456/913] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:57.599264 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f91c8c46-36c3-4936-82ef-307df1b22066 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139014 Sep 01 16:40:57.599264 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 458/914] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 16:40:57 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:58.390345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:58.391052 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:58.394364 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:58.396792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=12 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:58.399598 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.400145 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.400585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.401481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.401927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.402527 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.569576 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:58.570181 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:58.574236 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=12 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:58.580168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.580657 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.581095 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.581824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.582893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.588851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.591353 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:58.758733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:58.773865 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4919a356-6dd5-4847-b7a3-10db18331f0d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1691 microversion: 2.1 time: 0.387818 Sep 01 16:40:58.775295 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 457/915] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:58 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1691 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:59.110739 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:59.120957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:59.122764 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:59.124224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0f734a62-ac25-4834-991d-177bc5294ff0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1407 microversion: 2.20 time: 0.558775 Sep 01 16:40:59.125483 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 459/916] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:58 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:59.373148 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-91d3ddf7-ec3a-4321-889d-2f931912600e req-58cf906e-7391-417a-910e-e2c15076f813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d5141e-06e1-45b2-ad7a-11ae9de1a0bf", "tag": "1f17da61-a2b1-4c49-b455-712316c7f8c4"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:59.385450 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-91d3ddf7-ec3a-4321-889d-2f931912600e req-58cf906e-7391-417a-910e-e2c15076f813 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:59.386032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-91d3ddf7-ec3a-4321-889d-2f931912600e req-58cf906e-7391-417a-910e-e2c15076f813 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:59.386526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-91d3ddf7-ec3a-4321-889d-2f931912600e req-58cf906e-7391-417a-910e-e2c15076f813 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:59.390750 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:59.401101 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-91d3ddf7-ec3a-4321-889d-2f931912600e req-58cf906e-7391-417a-910e-e2c15076f813 service nova] Creating event network-changed:1f17da61-a2b1-4c49-b455-712316c7f8c4 for instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf on hv-cinder-83602 Sep 01 16:40:59.415788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-91d3ddf7-ec3a-4321-889d-2f931912600e req-58cf906e-7391-417a-910e-e2c15076f813 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040564 Sep 01 16:40:59.415788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 458/917] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:59.597801 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-e34322d3-206b-445e-9151-c4c9c357ba73 req-be2a9c24-dfea-4981-8d29-63037076caea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6a9ac9-616c-4e7b-a0f8-f37ba164254a", "name": "network-vif-deleted", "tag": "aa0e65b8-6c29-4bc7-a8bb-dd92861f558c"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:59.608848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-e34322d3-206b-445e-9151-c4c9c357ba73 req-be2a9c24-dfea-4981-8d29-63037076caea service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:59.609630 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-e34322d3-206b-445e-9151-c4c9c357ba73 req-be2a9c24-dfea-4981-8d29-63037076caea service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:59.610302 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-e34322d3-206b-445e-9151-c4c9c357ba73 req-be2a9c24-dfea-4981-8d29-63037076caea service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:59.626391 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-e34322d3-206b-445e-9151-c4c9c357ba73 req-be2a9c24-dfea-4981-8d29-63037076caea service nova] Creating event network-vif-deleted:aa0e65b8-6c29-4bc7-a8bb-dd92861f558c for instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a on hv-cinder-83602 Sep 01 16:40:59.631757 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-e34322d3-206b-445e-9151-c4c9c357ba73 req-be2a9c24-dfea-4981-8d29-63037076caea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038593 Sep 01 16:40:59.632441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 460/918] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:59.798123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:59.799111 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:59.808336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:59.809095 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:59.809693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:59.810598 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:59.811382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:59.811968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:59.885890 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:59.896631 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-95037776-637f-4df2-bf03-a8fe15dd07f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1623 microversion: 2.1 time: 0.103249 Sep 01 16:40:59.897398 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 459/919] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:59 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1623 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:00.151327 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:00.152041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:00.158485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.158975 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.159448 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:00.160145 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.160595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.161015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:00.238018 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-25938545"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:00.238476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:00.253336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.253859 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.255042 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:00.255042 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.255570 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.255997 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:00.360465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:00.370489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:00.372788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:00.373954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-485243f8-ea87-4b40-9f41-409ecb1f28a9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1407 microversion: 2.20 time: 0.228081 Sep 01 16:41:00.375226 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 461/920] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:00 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:00.426027 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.network.security_group_api [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Removing security group 0e70fc25-c0e4-4535-bb6f-493744e81b76 from port 9f8b31c0-0f62-4b60-8cd2-e60302efe717 Sep 01 16:41:00.860135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-88712355-cc67-4a95-9578-cea61fe1343f tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "POST /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/action" status: 202 len: 0 microversion: 2.1 time: 0.626032 Sep 01 16:41:00.860826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 460/921] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:41:00 2022] POST /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:00.924682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:00.925329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:00.933604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.934103 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.934548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:00.935277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.935722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.936529 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:01.023130 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:01.031834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a4a1f5c6-9d42-414a-be0f-76bee2171607 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1623 microversion: 2.1 time: 0.115821 Sep 01 16:41:01.043504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 462/922] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:00 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1623 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:01.397044 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:01.397985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:01.406512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:01.409654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:01.409654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:01.409654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:01.409654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:01.410059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:01.434784 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-958aac74-f821-40ae-8696-c66bd3480d30 req-288da0a3-d31b-47f3-95b1-0deea4e9b372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63da505-aaed-4f08-a8f8-a3dc1a11cf27", "tag": "9f8b31c0-0f62-4b60-8cd2-e60302efe717"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:01.449641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-958aac74-f821-40ae-8696-c66bd3480d30 req-288da0a3-d31b-47f3-95b1-0deea4e9b372 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:01.450644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-958aac74-f821-40ae-8696-c66bd3480d30 req-288da0a3-d31b-47f3-95b1-0deea4e9b372 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:01.451079 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-958aac74-f821-40ae-8696-c66bd3480d30 req-288da0a3-d31b-47f3-95b1-0deea4e9b372 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:01.466433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-958aac74-f821-40ae-8696-c66bd3480d30 req-288da0a3-d31b-47f3-95b1-0deea4e9b372 service nova] Creating event network-changed:9f8b31c0-0f62-4b60-8cd2-e60302efe717 for instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 on hv-cinder-83602 Sep 01 16:41:01.472072 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-958aac74-f821-40ae-8696-c66bd3480d30 req-288da0a3-d31b-47f3-95b1-0deea4e9b372 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044882 Sep 01 16:41:01.473440 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 463/923] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:01.767822 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:01.784807 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:01.786959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:01.788481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6d944e67-2451-4811-863b-1e91b65c43c4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1407 microversion: 2.20 time: 0.395797 Sep 01 16:41:01.789047 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 461/924] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:01 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:02.065183 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:02.099936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:02.154426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.159271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.159271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.159271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.159271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.162212 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.232353 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.233263 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.233862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.234462 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lazy-loading 'fault' on Instance uuid db6a9ac9-616c-4e7b-a0f8-f37ba164254a {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:02.318523 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:02.326546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-648d9450-01ce-4b31-8717-97f17606967f tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 200 len: 1335 microversion: 2.1 time: 0.275688 Sep 01 16:41:02.341263 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 464/925] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:02 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 1335 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:02.770931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:02.772150 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:02.779810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.780672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.781316 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.782325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.782997 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.783962 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.813565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:02.814558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:02.825640 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.826404 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.827129 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.834016 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.834840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.836211 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.951665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lazy-loading 'services' on Instance uuid a63da505-aaed-4f08-a8f8-a3dc1a11cf27 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:03.045296 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:03.059083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:03.065529 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:03.065529 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cd130b5c-11c1-4116-8b28-418dd064ccb1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1407 microversion: 2.20 time: 0.254606 Sep 01 16:41:03.066880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 465/926] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:02 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:03.349861 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:03.350471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: db6a9ac9-616c-4e7b-a0f8-f37ba164254a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:03.357655 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.358143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.358569 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.359282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.359730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.360146 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.374853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] HTTP exception thrown: Instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a could not be found. Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Request method failure captured: Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a HTTP/1.1 Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN6_WXIC-4YN6U5LS5fcBrN0KP39ZYvQMD8k382YHVI5cm-TQjlHo434Iwnvp2M43ARHAt1XySyvgZfg-eLZWx-AsqeF_TeQMpbbefYTSKSZKNi-6Egiu0koZcd5nF49Z71Gs9TqbXZ6y86lUE-lrXeyHRcF1zBka3L9MIa8d37TEto Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:41:03.376682 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f0958b1518e4439bf12959b7760abc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8937e9f80f1540e389ee283971624741 Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a could not be found. Sep 01 16:41:03.378107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'db6a9ac9-616c-4e7b-a0f8-f37ba164254a'} Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a could not be found. Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:03.378865 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a could not be found. Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a could not be found. Sep 01 16:41:03.380111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:03.381193 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4e218b94-90b5-4295-8217-445cd9be1c99 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments/065b88db-58d2-4b08-bae1-96dd1282ce30" status: 202 len: 0 microversion: 2.1 time: 0.609854 Sep 01 16:41:03.381278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Returning 404 to user: Instance db6a9ac9-616c-4e7b-a0f8-f37ba164254a could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:03.381278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7ad0c470-e7b8-4783-b12d-2d380f25106e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a" status: 404 len: 111 microversion: 2.1 time: 0.032804 Sep 01 16:41:03.381278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 466/927] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:03 2022] GET /compute/v2.1/servers/db6a9ac9-616c-4e7b-a0f8-f37ba164254a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:41:03.387467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 462/928] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:41:02 2022] DELETE /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments/065b88db-58d2-4b08-bae1-96dd1282ce30 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:03.393874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dd870fa9-df85-49a4-a36b-a1c98a9d0947 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:03.396506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dd870fa9-df85-49a4-a36b-a1c98a9d0947 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:03.405070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd870fa9-df85-49a4-a36b-a1c98a9d0947 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.405320 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4e38acf8-6fae-43ff-871b-8c9ac8d7accf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '.version_select at 0x7fe37a291040>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:03.406036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd870fa9-df85-49a4-a36b-a1c98a9d0947 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.406645 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd870fa9-df85-49a4-a36b-a1c98a9d0947 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.407541 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd870fa9-df85-49a4-a36b-a1c98a9d0947 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.408411 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd870fa9-df85-49a4-a36b-a1c98a9d0947 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.409012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd870fa9-df85-49a4-a36b-a1c98a9d0947 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.445182 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dd870fa9-df85-49a4-a36b-a1c98a9d0947 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055984 Sep 01 16:41:03.452036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 463/929] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:03 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:03.489561 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-7694952c-b4f4-4415-adb9-875de9c917cb req-1a0eeb32-b752-46bb-9c72-d8c7f13738ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63da505-aaed-4f08-a8f8-a3dc1a11cf27", "tag": "9f8b31c0-0f62-4b60-8cd2-e60302efe717"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:03.500943 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7694952c-b4f4-4415-adb9-875de9c917cb req-1a0eeb32-b752-46bb-9c72-d8c7f13738ba service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.501349 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4e38acf8-6fae-43ff-871b-8c9ac8d7accf tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547232865" status: 202 len: 0 microversion: 2.1 time: 0.116511 Sep 01 16:41:03.501467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7694952c-b4f4-4415-adb9-875de9c917cb req-1a0eeb32-b752-46bb-9c72-d8c7f13738ba service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.501967 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7694952c-b4f4-4415-adb9-875de9c917cb req-1a0eeb32-b752-46bb-9c72-d8c7f13738ba service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.502404 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 467/930] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 1 16:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547232865 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:41:03.527817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-7694952c-b4f4-4415-adb9-875de9c917cb req-1a0eeb32-b752-46bb-9c72-d8c7f13738ba service nova] Creating event network-changed:9f8b31c0-0f62-4b60-8cd2-e60302efe717 for instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 on hv-cinder-83602 Sep 01 16:41:03.532993 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-7694952c-b4f4-4415-adb9-875de9c917cb req-1a0eeb32-b752-46bb-9c72-d8c7f13738ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047613 Sep 01 16:41:03.533963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 464/931] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:04.098411 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:04.099188 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:04.106098 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:04.106582 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:04.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:04.108061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:04.108540 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:04.108960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:04.298480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:04.305833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:04.307524 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:04.308660 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-adf578ad-07aa-47a2-937e-7fc6b0784c53 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1407 microversion: 2.20 time: 0.214321 Sep 01 16:41:04.309223 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 468/932] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:04 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:04.460119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-30b3e8f7-fe29-4d8a-8202-4736df19344c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:04.465564 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-30b3e8f7-fe29-4d8a-8202-4736df19344c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:04.474914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30b3e8f7-fe29-4d8a-8202-4736df19344c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:04.475877 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30b3e8f7-fe29-4d8a-8202-4736df19344c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:04.476536 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30b3e8f7-fe29-4d8a-8202-4736df19344c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:04.477841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30b3e8f7-fe29-4d8a-8202-4736df19344c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:04.478814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30b3e8f7-fe29-4d8a-8202-4736df19344c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:04.480015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30b3e8f7-fe29-4d8a-8202-4736df19344c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:04.515034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-30b3e8f7-fe29-4d8a-8202-4736df19344c tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060351 Sep 01 16:41:04.515678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 465/933] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:04 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:04.697353 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-8cad8085-37fb-49cd-8d0c-e347e894e57b req-2be68211-56d9-4d18-9a25-3b5f79b8e8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3", "name": "network-vif-plugged", "status": "completed", "tag": "611fe9aa-a99e-4482-9ba2-a177311f9a82"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:04.708175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-8cad8085-37fb-49cd-8d0c-e347e894e57b req-2be68211-56d9-4d18-9a25-3b5f79b8e8cf service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:04.709242 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-8cad8085-37fb-49cd-8d0c-e347e894e57b req-2be68211-56d9-4d18-9a25-3b5f79b8e8cf service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:04.709769 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-8cad8085-37fb-49cd-8d0c-e347e894e57b req-2be68211-56d9-4d18-9a25-3b5f79b8e8cf service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:04.723211 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-8cad8085-37fb-49cd-8d0c-e347e894e57b req-2be68211-56d9-4d18-9a25-3b5f79b8e8cf service nova] Creating event network-vif-plugged:611fe9aa-a99e-4482-9ba2-a177311f9a82 for instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 on hv-cinder-83602 Sep 01 16:41:04.728680 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-8cad8085-37fb-49cd-8d0c-e347e894e57b req-2be68211-56d9-4d18-9a25-3b5f79b8e8cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052082 Sep 01 16:41:04.730474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 469/934] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:05.331705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:05.335767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:05.344177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.345659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.346186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.346914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.347457 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.347893 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.494132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:05.502397 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:05.503807 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:05.504915 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7612bf6b-d10c-4a82-9947-49563e9fc032 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1407 microversion: 2.20 time: 0.177490 Sep 01 16:41:05.505473 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 466/935] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:05 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:05.530245 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f970de42-2ce4-4596-9ce1-1a8bfa6c0a19 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:05.532519 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f970de42-2ce4-4596-9ce1-1a8bfa6c0a19 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:05.538681 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f970de42-2ce4-4596-9ce1-1a8bfa6c0a19 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.539187 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f970de42-2ce4-4596-9ce1-1a8bfa6c0a19 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.539669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f970de42-2ce4-4596-9ce1-1a8bfa6c0a19 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.540366 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f970de42-2ce4-4596-9ce1-1a8bfa6c0a19 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.540863 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f970de42-2ce4-4596-9ce1-1a8bfa6c0a19 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.541280 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f970de42-2ce4-4596-9ce1-1a8bfa6c0a19 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.570616 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f970de42-2ce4-4596-9ce1-1a8bfa6c0a19 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045597 Sep 01 16:41:05.571887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 470/936] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:05 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:41:05.582247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:05.582787 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:05.584940 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:05.590122 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.590604 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.591038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.591757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.592257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.592679 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.675054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] HTTP exception thrown: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 is not attached to volume 065b88db-58d2-4b08-bae1-96dd1282ce30 Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Request method failure captured: Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments/065b88db-58d2-4b08-bae1-96dd1282ce30 HTTP/1.1 Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN9zQM6OmOqlogK-oiTNfz5V_HDobhb4WYkazx_AadKNdU1xRp9oAoeK4piYFwpwnr9syW2kkOKnnCRAFT50692_c_cDln4oGGCOI936pJho141zXgpZmFpOdHR0dxdKEKqJ4Hz_Ew_2nQz7SOb631JmpGHxOamPXdrOphgOxBhXXrU Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: 9193c40d930d4774b800ddfeefbf8c92 Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-TestMinimumBasicScenario-300945205 Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:41:05.677506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9193c40d930d4774b800ddfeefbf8c92", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9193c40d930d4774b800ddfeefbf8c92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9193c40d930d4774b800ddfeefbf8c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9193c40d930d4774b800ddfeefbf8c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-TestMinimumBasicScenario-300945205 Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 9193c40d930d4774b800ddfeefbf8c92 Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-TestMinimumBasicScenario-300945205 Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-TestMinimumBasicScenario-300945205-project Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: cf9862b97ba64cc09b4903ba24ac2181 Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-TestMinimumBasicScenario-300945205-project Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:41:05.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 is not attached to volume 065b88db-58d2-4b08-bae1-96dd1282ce30 Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'server_id': 'a63da505-aaed-4f08-a8f8-a3dc1a11cf27', 'id': '065b88db-58d2-4b08-bae1-96dd1282ce30'} Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 065b88db-58d2-4b08-bae1-96dd1282ce30. Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:05.686484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 is not attached to volume 065b88db-58d2-4b08-bae1-96dd1282ce30 Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 is not attached to volume 065b88db-58d2-4b08-bae1-96dd1282ce30 Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:05.688476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Returning 404 to user: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 is not attached to volume 065b88db-58d2-4b08-bae1-96dd1282ce30 {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:05.689827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0695cd45-c9c2-40e4-b497-e684311b9929 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments/065b88db-58d2-4b08-bae1-96dd1282ce30" status: 404 len: 154 microversion: 2.1 time: 0.100762 Sep 01 16:41:05.689827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 467/937] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:41:05 2022] DELETE /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27/os-volume_attachments/065b88db-58d2-4b08-bae1-96dd1282ce30 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:06.527719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:06.528339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:06.534536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.535177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.535494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.536165 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.536661 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.537046 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.680717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:06.688951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:06.690419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:06.691566 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-94a9c701-c7ab-442e-aea7-3625b9dd1dfe tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1407 microversion: 2.20 time: 0.168642 Sep 01 16:41:06.693077 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 471/938] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:06 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:06.938241 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:06.938780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:06.948933 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.949789 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.950461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.951592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.952310 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.952982 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.954686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:06.955527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:06.965882 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.966678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.967426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.968557 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.969292 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.969981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.991921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:41:07.002351 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:41:07.242994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:07.313202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a43eb436-5c65-41e9-aba1-9fffa09701ed tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 204 len: 0 microversion: 2.1 time: 0.378421 Sep 01 16:41:07.314253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 468/939] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:41:06 2022] DELETE /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:07.325716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:07.326599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:07.332681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.333162 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.333864 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.334540 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.334988 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.335435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.338383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6007d273-839e-436f-888f-6f1be82fa968 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 204 len: 0 microversion: 2.1 time: 0.390187 Sep 01 16:41:07.338973 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 472/940] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:41:06 2022] DELETE /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:07.347302 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:07.349076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:07.354606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.355209 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.355712 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.356489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.357088 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.357611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.482307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.490485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0194f4c1-14b7-4147-851c-2db05e9f3324 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1554 microversion: 2.1 time: 0.171154 Sep 01 16:41:07.491071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 469/941] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:07 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:07.495367 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.503281 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0e9912b2-7700-435b-9f46-715706384911 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1508 microversion: 2.1 time: 0.159942 Sep 01 16:41:07.503868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 473/942] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:07 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:07.716092 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:07.716692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:07.722865 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.723832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.724008 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.724715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.725161 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.725577 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.860772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.874496 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.875961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.877079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b5e876d7-493d-4ae2-8da3-789f5d305df5 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1407 microversion: 2.20 time: 0.165432 Sep 01 16:41:07.877629 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 470/943] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:07 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:08.512324 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:08.512880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:08.519718 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.520214 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.520654 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.521363 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.521820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.522246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.525327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:08.525942 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:08.532441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.532946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.533359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.534051 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.534502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.534921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.666032 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:08.674593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f159e9d3-db01-4403-8f1a-d2cbc13e30cd tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1554 microversion: 2.1 time: 0.166813 Sep 01 16:41:08.675209 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 474/944] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:08 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:08.676205 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:08.684170 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-226832a0-11dc-47f0-b652-00426c2bc535 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1508 microversion: 2.1 time: 0.163249 Sep 01 16:41:08.684746 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 471/945] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:08 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:08.899504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:08.900115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:08.906074 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.906563 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.906997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.907729 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.908180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.908606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.036807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:09.044993 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:09.046455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:09.047664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4faf28e6-bf38-4da5-9a9b-d4afdf85844c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1598 microversion: 2.20 time: 0.152155 Sep 01 16:41:09.048233 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 475/946] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:08 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:09.069800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1447b902-1acb-40c1-90d3-992a5c54fb26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:09.070300 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1447b902-1acb-40c1-90d3-992a5c54fb26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:09.076806 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1447b902-1acb-40c1-90d3-992a5c54fb26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.077289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1447b902-1acb-40c1-90d3-992a5c54fb26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.077722 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1447b902-1acb-40c1-90d3-992a5c54fb26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.078410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1447b902-1acb-40c1-90d3-992a5c54fb26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.078862 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1447b902-1acb-40c1-90d3-992a5c54fb26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.079309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1447b902-1acb-40c1-90d3-992a5c54fb26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.157116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1447b902-1acb-40c1-90d3-992a5c54fb26 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091165 Sep 01 16:41:09.157714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 472/947] 10.222.0.16 () {60 vars in 1316 bytes} [Thu Sep 1 16:41:09 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:41:09.697443 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:09.698133 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:09.709671 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:09.710132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.710705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:09.710825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.711467 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.712614 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.713342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.714289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.721519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.722292 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.723312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.724706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.725542 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.726221 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.904748 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:09.912947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2dd9c4c6-1237-4267-9bbc-0e8b129e08f1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1508 microversion: 2.1 time: 0.211098 Sep 01 16:41:09.913538 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 473/948] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:09 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:09.986070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:09.995039 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5c48a187-2f1a-4b72-ab7f-3a1ad965b920 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1554 microversion: 2.1 time: 0.302299 Sep 01 16:41:09.995667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 476/949] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:09 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1554 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:10.491641 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-980f75a5-183e-40ea-a115-6f19af7db1fb req-0a8bec12-16ac-4e5e-a5c4-62df11af18ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3", "tag": "611fe9aa-a99e-4482-9ba2-a177311f9a82"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:10.502192 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-980f75a5-183e-40ea-a115-6f19af7db1fb req-0a8bec12-16ac-4e5e-a5c4-62df11af18ab service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:10.502359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-980f75a5-183e-40ea-a115-6f19af7db1fb req-0a8bec12-16ac-4e5e-a5c4-62df11af18ab service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:10.502826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-980f75a5-183e-40ea-a115-6f19af7db1fb req-0a8bec12-16ac-4e5e-a5c4-62df11af18ab service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:10.515365 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-980f75a5-183e-40ea-a115-6f19af7db1fb req-0a8bec12-16ac-4e5e-a5c4-62df11af18ab service nova] Creating event network-changed:611fe9aa-a99e-4482-9ba2-a177311f9a82 for instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 on hv-cinder-83602 Sep 01 16:41:10.520347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-980f75a5-183e-40ea-a115-6f19af7db1fb req-0a8bec12-16ac-4e5e-a5c4-62df11af18ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032708 Sep 01 16:41:10.520941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 474/950] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:10.934690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:10.935763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:10.941730 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:10.942218 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:10.942656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:10.943412 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:10.943869 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:10.944294 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:10.965275 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:11.191122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:11.206979 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3dcdbd89-8fc2-4955-af67-d57efdd72520 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1508 microversion: 2.1 time: 0.276634 Sep 01 16:41:11.221853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 477/951] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:10 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:11.309331 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:11.310719 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:11.318389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:11.319322 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:11.320134 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:11.321719 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:11.322387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:11.323042 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:11.336089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:11.470639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:11.501697 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e2dc8ab0-b670-45bb-99d7-acab45fe0fc4 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1512 microversion: 2.1 time: 0.485842 Sep 01 16:41:11.519503 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 475/952] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:11 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1512 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:11.586760 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-c4baa160-cc38-47ea-ac18-0e3fd4517b12 req-089271a5-d44f-40fe-a0d0-a6b312ee9d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63da505-aaed-4f08-a8f8-a3dc1a11cf27", "name": "network-vif-deleted", "tag": "9f8b31c0-0f62-4b60-8cd2-e60302efe717"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:11.599482 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-c4baa160-cc38-47ea-ac18-0e3fd4517b12 req-089271a5-d44f-40fe-a0d0-a6b312ee9d5f service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:11.599482 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-c4baa160-cc38-47ea-ac18-0e3fd4517b12 req-089271a5-d44f-40fe-a0d0-a6b312ee9d5f service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:11.599920 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-c4baa160-cc38-47ea-ac18-0e3fd4517b12 req-089271a5-d44f-40fe-a0d0-a6b312ee9d5f service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:11.613586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-c4baa160-cc38-47ea-ac18-0e3fd4517b12 req-089271a5-d44f-40fe-a0d0-a6b312ee9d5f service nova] Creating event network-vif-deleted:9f8b31c0-0f62-4b60-8cd2-e60302efe717 for instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 on hv-cinder-83602 Sep 01 16:41:11.619980 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-c4baa160-cc38-47ea-ac18-0e3fd4517b12 req-089271a5-d44f-40fe-a0d0-a6b312ee9d5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037300 Sep 01 16:41:11.631724 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 478/953] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:12.229938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:12.229938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:12.238084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.238620 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.243629 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.243629 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.243629 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.243629 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.292974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.293698 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.294123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.294574 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lazy-loading 'fault' on Instance uuid 4f9ab9d9-bf46-47be-a669-b7262afa36c5 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:12.347074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:12.355524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3c08af3f-638b-496b-b1e1-c4d22c154876 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1312 microversion: 2.1 time: 0.130935 Sep 01 16:41:12.356032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 476/954] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:12 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:12.540008 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:12.540606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-882b3e53-c4d5-4a73-988b-5c4dd9647e00 req-8a6bb263-cb88-42d8-aa7c-5a4a1dfcc453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9ab9d9-bf46-47be-a669-b7262afa36c5", "name": "network-vif-deleted", "tag": "72a909ce-ea6e-4de0-9ca1-03139d0f535e"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:12.541341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:12.551314 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.551560 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-882b3e53-c4d5-4a73-988b-5c4dd9647e00 req-8a6bb263-cb88-42d8-aa7c-5a4a1dfcc453 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.551879 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.552030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-882b3e53-c4d5-4a73-988b-5c4dd9647e00 req-8a6bb263-cb88-42d8-aa7c-5a4a1dfcc453 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.552291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.552404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-882b3e53-c4d5-4a73-988b-5c4dd9647e00 req-8a6bb263-cb88-42d8-aa7c-5a4a1dfcc453 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.553004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.553462 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.554199 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.566587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-882b3e53-c4d5-4a73-988b-5c4dd9647e00 req-8a6bb263-cb88-42d8-aa7c-5a4a1dfcc453 service nova] Creating event network-vif-deleted:72a909ce-ea6e-4de0-9ca1-03139d0f535e for instance 4f9ab9d9-bf46-47be-a669-b7262afa36c5 on hv-cinder-83602 Sep 01 16:41:12.572536 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-882b3e53-c4d5-4a73-988b-5c4dd9647e00 req-8a6bb263-cb88-42d8-aa7c-5a4a1dfcc453 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036456 Sep 01 16:41:12.573910 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 477/955] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:12.594249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.594746 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.595206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.595662 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lazy-loading 'fault' on Instance uuid a63da505-aaed-4f08-a8f8-a3dc1a11cf27 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:12.648279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9862b97ba64cc09b4903ba24ac2181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193c40d930d4774b800ddfeefbf8c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:12.658769 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-442ec5b0-9501-43d1-8e23-4c7cd1b64878 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 200 len: 1348 microversion: 2.1 time: 0.124656 Sep 01 16:41:12.661483 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 479/956] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:12 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 1348 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:13.379482 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:13.380180 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:13.388594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.389067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.389497 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.390803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.391279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.391701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.426209 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.427022 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.427499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.427952 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lazy-loading 'fault' on Instance uuid 4f9ab9d9-bf46-47be-a669-b7262afa36c5 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:13.472419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:13.480822 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0df12e19-b951-4c17-911f-a892c34dfad8 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 200 len: 1312 microversion: 2.1 time: 0.106524 Sep 01 16:41:13.481621 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 478/957] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:13 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:13.698182 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:13.743510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] [instance: a63da505-aaed-4f08-a8f8-a3dc1a11cf27] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:13.743510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.743510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.743510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.743989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.743989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.743989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.743989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] HTTP exception thrown: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 could not be found. Sep 01 16:41:13.743989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Request method failure captured: Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 HTTP/1.1 Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN9zQM6OmOqlogK-oiTNfz5V_HDobhb4WYkazx_AadKNdU1xRp9oAoeK4piYFwpwnr9syW2kkOKnnCRAFT50692_c_cDln4oGGCOI936pJho141zXgpZmFpOdHR0dxdKEKqJ4Hz_Ew_2nQz7SOb631JmpGHxOamPXdrOphgOxBhXXrU Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 9193c40d930d4774b800ddfeefbf8c92 Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-TestMinimumBasicScenario-300945205 Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:41:13.744417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9193c40d930d4774b800ddfeefbf8c92", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9193c40d930d4774b800ddfeefbf8c92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9193c40d930d4774b800ddfeefbf8c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9193c40d930d4774b800ddfeefbf8c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-TestMinimumBasicScenario-300945205 Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 9193c40d930d4774b800ddfeefbf8c92 Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-TestMinimumBasicScenario-300945205 Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-TestMinimumBasicScenario-300945205-project Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: cf9862b97ba64cc09b4903ba24ac2181 Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-TestMinimumBasicScenario-300945205-project Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 could not be found. Sep 01 16:41:13.745939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'a63da505-aaed-4f08-a8f8-a3dc1a11cf27'} Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 could not be found. Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:13.746878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 could not be found. Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 could not be found. Sep 01 16:41:13.748439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:13.749820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Returning 404 to user: Instance a63da505-aaed-4f08-a8f8-a3dc1a11cf27 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:13.749820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3271cd38-1754-48bd-b943-a2a84010b667 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27" status: 404 len: 111 microversion: 2.1 time: 0.033350 Sep 01 16:41:13.749820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 480/958] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:13 2022] GET /compute/v2.1/servers/a63da505-aaed-4f08-a8f8-a3dc1a11cf27 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:13.750089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eb427bb5-7dd9-4021-ac9a-fdb6c75f1fb6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] Calling method '.version_select at 0x7fe37d783a60>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:14.035917 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eb427bb5-7dd9-4021-ac9a-fdb6c75f1fb6 tempest-TestMinimumBasicScenario-300945205 tempest-TestMinimumBasicScenario-300945205-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1855903187" status: 202 len: 0 microversion: 2.1 time: 0.303501 Sep 01 16:41:14.036515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 479/959] 10.222.0.16 () {58 vars in 1272 bytes} [Thu Sep 1 16:41:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1855903187 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:14.502624 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:14.503269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: 4f9ab9d9-bf46-47be-a669-b7262afa36c5] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:14.510160 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.514587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.514587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.514587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.514587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.514987 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.527419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] HTTP exception thrown: Instance 4f9ab9d9-bf46-47be-a669-b7262afa36c5 could not be found. Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Request method failure captured: Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 HTTP/1.1 Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN6_WXIC-4YN6U5LS5fcBrN0KP39ZYvQMD8k382YHVI5cm-TQjlHo434Iwnvp2M43ARHAt1XySyvgZfg-eLZWx-AsqeF_TeQMpbbefYTSKSZKNi-6Egiu0koZcd5nF49Z71Gs9TqbXZ6y86lUE-lrXeyHRcF1zBka3L9MIa8d37TEto Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:41:14.528957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f0958b1518e4439bf12959b7760abc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8937e9f80f1540e389ee283971624741 Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 4f9ab9d9-bf46-47be-a669-b7262afa36c5 could not be found. Sep 01 16:41:14.530543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '4f9ab9d9-bf46-47be-a669-b7262afa36c5'} Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9ab9d9-bf46-47be-a669-b7262afa36c5 could not be found. Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:14.531504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9ab9d9-bf46-47be-a669-b7262afa36c5 could not be found. Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9ab9d9-bf46-47be-a669-b7262afa36c5 could not be found. Sep 01 16:41:14.533030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:14.534432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Returning 404 to user: Instance 4f9ab9d9-bf46-47be-a669-b7262afa36c5 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:14.534432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c7336042-772e-40a0-9135-fd9272ed6afb tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5" status: 404 len: 111 microversion: 2.1 time: 0.031604 Sep 01 16:41:14.534432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 481/960] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:14 2022] GET /compute/v2.1/servers/4f9ab9d9-bf46-47be-a669-b7262afa36c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:14.543534 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:14.543534 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:14.547272 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.547759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.548191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.548879 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.549327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.549773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.578593 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:41:14.859254 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2b4ae2c9-db77-49a0-bacd-b6533b1840c7 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 204 len: 0 microversion: 2.1 time: 0.323501 Sep 01 16:41:14.859841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 480/961] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:41:14 2022] DELETE /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:14.867982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:14.868755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:14.875635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.876114 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.876546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.877230 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.877674 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.878087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.012752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:15.020530 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ed5bfe54-871b-4db4-8be4-2b8252a0c27e tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.156416 Sep 01 16:41:15.021093 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 482/962] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:14 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:16.044489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:16.050869 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:16.052934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.053759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.054308 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.055188 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.056647 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.057304 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.302522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:16.310596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2ebc4af8-cb2c-4b59-a422-9480ffb73242 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1523 microversion: 2.1 time: 0.271740 Sep 01 16:41:16.311190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 481/963] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:16 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:16.424492 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-14ccb009-3c5a-41b2-901b-344ba41f9e0d req-6aca3af8-0024-4a35-8338-a03429f9274f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4209cd9-68c3-4e8a-9c4c-d560a8d74045", "name": "network-vif-deleted", "tag": "6cb7a377-8b7d-4061-a223-f3f3c40c8fae"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:16.441987 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-14ccb009-3c5a-41b2-901b-344ba41f9e0d req-6aca3af8-0024-4a35-8338-a03429f9274f service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:16.443176 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-14ccb009-3c5a-41b2-901b-344ba41f9e0d req-6aca3af8-0024-4a35-8338-a03429f9274f service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:16.443802 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-14ccb009-3c5a-41b2-901b-344ba41f9e0d req-6aca3af8-0024-4a35-8338-a03429f9274f service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:16.458138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-14ccb009-3c5a-41b2-901b-344ba41f9e0d req-6aca3af8-0024-4a35-8338-a03429f9274f service nova] Creating event network-vif-deleted:6cb7a377-8b7d-4061-a223-f3f3c40c8fae for instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 on hv-cinder-83602 Sep 01 16:41:16.464605 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-14ccb009-3c5a-41b2-901b-344ba41f9e0d req-6aca3af8-0024-4a35-8338-a03429f9274f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043548 Sep 01 16:41:16.465395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 483/964] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:17.332936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:17.333672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:17.342713 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.343304 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.345797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.345797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.345797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.345797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.379438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.379979 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.380352 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.380795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lazy-loading 'fault' on Instance uuid d4209cd9-68c3-4e8a-9c4c-d560a8d74045 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:17.448913 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8937e9f80f1540e389ee283971624741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0958b1518e4439bf12959b7760abc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:17.454329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1533cc84-b46b-425e-9964-0fa94bc5d28d tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 200 len: 1312 microversion: 2.1 time: 0.125760 Sep 01 16:41:17.454923 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 482/965] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:17 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 1312 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:18.476687 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:18.477455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] [instance: d4209cd9-68c3-4e8a-9c4c-d560a8d74045] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:18.484249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.484739 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.485175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.485876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.486334 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.486755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.500671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] HTTP exception thrown: Instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 could not be found. Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Request method failure captured: Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 HTTP/1.1 Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN6_WXIC-4YN6U5LS5fcBrN0KP39ZYvQMD8k382YHVI5cm-TQjlHo434Iwnvp2M43ARHAt1XySyvgZfg-eLZWx-AsqeF_TeQMpbbefYTSKSZKNi-6Egiu0koZcd5nF49Z71Gs9TqbXZ6y86lUE-lrXeyHRcF1zBka3L9MIa8d37TEto Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:41:18.502243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f0958b1518e4439bf12959b7760abc4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f0958b1518e4439bf12959b7760abc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 2f0958b1518e4439bf12959b7760abc4 Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1344907569 Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8937e9f80f1540e389ee283971624741 Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1344907569-project Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 could not be found. Sep 01 16:41:18.503963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'd4209cd9-68c3-4e8a-9c4c-d560a8d74045'} Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 could not be found. Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:18.504824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 could not be found. Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 could not be found. Sep 01 16:41:18.506036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:18.509513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] Returning 404 to user: Instance d4209cd9-68c3-4e8a-9c4c-d560a8d74045 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:18.509513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4a101a5e-93c8-41ad-82d8-64ad8d37cba1 tempest-ServerRescueNegativeTestJSON-1344907569 tempest-ServerRescueNegativeTestJSON-1344907569-project] 10.222.0.16 "GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045" status: 404 len: 111 microversion: 2.1 time: 0.031839 Sep 01 16:41:18.509513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 484/966] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:18 2022] GET /compute/v2.1/servers/d4209cd9-68c3-4e8a-9c4c-d560a8d74045 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:25.077375 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9675f997-210e-4333-b6d8-0e2b9862d94f tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Action: 'create', calling method: .version_select at 0x7fe37d8a8940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-298565310"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:25.721885 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9675f997-210e-4333-b6d8-0e2b9862d94f tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.761456 Sep 01 16:41:25.724587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 483/967] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Sep 1 16:41:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 763 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 16:41:25.735463 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f2e8c275-6a3b-45c4-bafc-101cdbcc0814 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe379ff14c0>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:25.795296 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f2e8c275-6a3b-45c4-bafc-101cdbcc0814 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75" status: 200 len: 344 microversion: 2.1 time: 0.063631 Sep 01 16:41:25.795874 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 485/968] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:41:25 2022] GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:26.809286 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-24d11a4c-fe7a-4a6d-ba6c-e4621cff1b29 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe379f349d0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:26.857415 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-24d11a4c-fe7a-4a6d-ba6c-e4621cff1b29 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75" status: 200 len: 344 microversion: 2.1 time: 0.052921 Sep 01 16:41:26.857978 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 484/969] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:41:26 2022] GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:27.872901 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3f3dc77c-74ec-4979-8803-fdecbfb9dcde tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37a463c10>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:27.921205 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3f3dc77c-74ec-4979-8803-fdecbfb9dcde tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75" status: 200 len: 345 microversion: 2.1 time: 0.052803 Sep 01 16:41:27.921782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 486/970] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:41:27 2022] GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:27.931736 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:27.932581 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:27.936894 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-65976484-b2d1-46ae-9987-5122c85e67e1 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Action: 'create', calling method: .version_select at 0x7fe37d8cb5e0>, body: {"snapshot": {"volume_id": "d46e92d8-ae88-46aa-93ea-d72654d1bd75", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-604592965"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:28.489317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-65976484-b2d1-46ae-9987-5122c85e67e1 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.558941 Sep 01 16:41:28.489906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 485/971] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Sep 1 16:41:27 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:28.498486 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:28.499811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=26 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:28.502889 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d7642852-c40e-45d8-bfa3-ece236da872c tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37a0a6ca0>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:28.534100 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d7642852-c40e-45d8-bfa3-ece236da872c tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 200 len: 286 microversion: 2.1 time: 0.036412 Sep 01 16:41:28.534718 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 487/972] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 16:41:28 2022] GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:28.545129 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-172d7e8c-5a8b-4e7c-b61e-6e059d6a0f54 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe379f34550>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:28.583776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-172d7e8c-5a8b-4e7c-b61e-6e059d6a0f54 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035050 Sep 01 16:41:28.583776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 486/973] 10.222.0.16 () {58 vars in 1140 bytes} [Thu Sep 1 16:41:28 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:28.592970 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-00db9190-026f-4cdf-bf36-3b2f1043dcee tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37a051700>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:28.624459 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-00db9190-026f-4cdf-bf36-3b2f1043dcee tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 200 len: 286 microversion: 2.1 time: 0.035156 Sep 01 16:41:28.625108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 488/974] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 16:41:28 2022] GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:29.645603 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cfc34baf-c92b-4166-90f1-0b4bd8caa439 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37d8703a0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:29.675947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cfc34baf-c92b-4166-90f1-0b4bd8caa439 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 200 len: 286 microversion: 2.1 time: 0.034764 Sep 01 16:41:29.676668 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 487/975] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 16:41:29 2022] GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:30.690563 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c046be83-b463-4649-ab98-0a9605f88673 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37d86c430>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.722993 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c046be83-b463-4649-ab98-0a9605f88673 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 200 len: 286 microversion: 2.1 time: 0.037694 Sep 01 16:41:30.723676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 489/976] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 16:41:30 2022] GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:31.737069 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8118b460-10ba-485c-ba9a-d204ab323a56 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37d8cba60>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:31.767960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8118b460-10ba-485c-ba9a-d204ab323a56 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 200 len: 286 microversion: 2.1 time: 0.035905 Sep 01 16:41:31.768532 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 488/977] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 16:41:31 2022] GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:32.781749 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-08b577c3-8e67-4616-ac7a-c5648572e801 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37a0a6940>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:32.811945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-08b577c3-8e67-4616-ac7a-c5648572e801 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 200 len: 286 microversion: 2.1 time: 0.034520 Sep 01 16:41:32.814348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 490/978] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 16:41:32 2022] GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:33.825649 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-79b8abab-d3a4-451e-bd67-bcf1ff4171bb tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37d8511f0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:33.854613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-79b8abab-d3a4-451e-bd67-bcf1ff4171bb tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 200 len: 287 microversion: 2.1 time: 0.034057 Sep 01 16:41:33.855186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 489/979] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 16:41:33 2022] GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:33.866548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4b47a372-21d4-4da8-9f92-0ff61176554c tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe379ff1160>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:33.996355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4b47a372-21d4-4da8-9f92-0ff61176554c tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 202 len: 0 microversion: 2.1 time: 0.133960 Sep 01 16:41:33.998337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 491/980] 10.222.0.16 () {58 vars in 1254 bytes} [Thu Sep 1 16:41:33 2022] DELETE /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:34.005317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-15980e6a-9ffa-4862-a7e3-ccbf6f1ae208 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37d8a8550>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:34.036160 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-15980e6a-9ffa-4862-a7e3-ccbf6f1ae208 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 200 len: 286 microversion: 2.1 time: 0.034769 Sep 01 16:41:34.036723 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 490/981] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 16:41:34 2022] GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:35.049146 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a27d9fa4-d79f-4bd3-b6fb-a5e5c7a24e13 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37a051700>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:35.075835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-a27d9fa4-d79f-4bd3-b6fb-a5e5c7a24e13 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] HTTP exception thrown: Snapshot ff43bc28-6d69-4dee-83d0-8d0a14780ee0 could not be found. Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a27d9fa4-d79f-4bd3-b6fb-a5e5c7a24e13 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Request method failure captured: Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 HTTP/1.1 Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEOC0vIk866cpeYKwnL-OLXFLbeVU_W7PYqZfa_XUfH78Yq6uZUt0u76o1PadBWbPQt5Xlb07cnW1MA45NZUGiSOy9ta-Q-K7vHaL2fUi3cA57vD4GdpRc3r7vKOmtc3w0nTUrS4q153tg04LsBMg3RbMa06POSIpovRcM9rs5G9f4o8 Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 389e5ef34dcd47728ad0e57d77364f1e Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:41:35.080132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_389e5ef34dcd47728ad0e57d77364f1e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 389e5ef34dcd47728ad0e57d77364f1e Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-VolumesSnapshotsTestJSON-1343829817-project Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: fd6962beac3345d1901e977712c99ac8 Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1343829817-project Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Snapshot ff43bc28-6d69-4dee-83d0-8d0a14780ee0 could not be found. Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'ff43bc28-6d69-4dee-83d0-8d0a14780ee0'} Sep 01 16:41:35.081732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ff43bc28-6d69-4dee-83d0-8d0a14780ee0 could not be found. (HTTP 404) (Request-ID: req-1857d7b6-01e4-4d88-a438-ae0bcf45e801) Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:35.082825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:41:35.084224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ff43bc28-6d69-4dee-83d0-8d0a14780ee0 could not be found. Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 16:41:35.086235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ff43bc28-6d69-4dee-83d0-8d0a14780ee0 could not be found. Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ff43bc28-6d69-4dee-83d0-8d0a14780ee0 could not be found. Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a27d9fa4-d79f-4bd3-b6fb-a5e5c7a24e13 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Returning 404 to user: Snapshot ff43bc28-6d69-4dee-83d0-8d0a14780ee0 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:35.087983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a27d9fa4-d79f-4bd3-b6fb-a5e5c7a24e13 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0" status: 404 len: 111 microversion: 2.1 time: 0.036703 Sep 01 16:41:35.089062 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 492/982] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 16:41:35 2022] GET /compute/v2.1/os-snapshots/ff43bc28-6d69-4dee-83d0-8d0a14780ee0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:35.091118 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d9b89d61-8115-47c6-bfe8-30353218edc8 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe379f34af0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:35.294841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d9b89d61-8115-47c6-bfe8-30353218edc8 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75" status: 202 len: 0 microversion: 2.1 time: 0.208055 Sep 01 16:41:35.295465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 491/983] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:41:35 2022] DELETE /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:35.303476 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6864adc2-7ee3-4251-b88d-346fa4391dbb tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37d7f69d0>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:35.351792 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6864adc2-7ee3-4251-b88d-346fa4391dbb tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75" status: 200 len: 344 microversion: 2.1 time: 0.051962 Sep 01 16:41:35.352357 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 493/984] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:41:35 2022] GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:36.366137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-20675e54-1b3f-4f2c-a6b8-ea71cd576851 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37d8a8940>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:36.394329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-20675e54-1b3f-4f2c-a6b8-ea71cd576851 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] HTTP exception thrown: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-20675e54-1b3f-4f2c-a6b8-ea71cd576851 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Request method failure captured: Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 HTTP/1.1 Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEOC0vIk866cpeYKwnL-OLXFLbeVU_W7PYqZfa_XUfH78Yq6uZUt0u76o1PadBWbPQt5Xlb07cnW1MA45NZUGiSOy9ta-Q-K7vHaL2fUi3cA57vD4GdpRc3r7vKOmtc3w0nTUrS4q153tg04LsBMg3RbMa06POSIpovRcM9rs5G9f4o8 Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: 389e5ef34dcd47728ad0e57d77364f1e Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:41:36.396464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_389e5ef34dcd47728ad0e57d77364f1e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 389e5ef34dcd47728ad0e57d77364f1e Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesSnapshotsTestJSON-1343829817-project Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: fd6962beac3345d1901e977712c99ac8 Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1343829817-project Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'd46e92d8-ae88-46aa-93ea-d72654d1bd75'} Sep 01 16:41:36.398030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. (HTTP 404) (Request-ID: req-15e2b5e0-0d31-4152-b00b-cc7741f10f99) Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:36.399204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:41:36.401194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:41:36.402410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-20675e54-1b3f-4f2c-a6b8-ea71cd576851 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Returning 404 to user: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-20675e54-1b3f-4f2c-a6b8-ea71cd576851 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75" status: 404 len: 109 microversion: 2.1 time: 0.036176 Sep 01 16:41:36.403726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 492/985] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:41:36 2022] GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:36.413320 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-16382f93-95e5-44fb-a4b7-9fc61742ac0f tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37d86c280>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:36.444645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-16382f93-95e5-44fb-a4b7-9fc61742ac0f tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] HTTP exception thrown: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-16382f93-95e5-44fb-a4b7-9fc61742ac0f tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Request method failure captured: Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: DELETE /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 HTTP/1.1 Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEOC0vIk866cpeYKwnL-OLXFLbeVU_W7PYqZfa_XUfH78Yq6uZUt0u76o1PadBWbPQt5Xlb07cnW1MA45NZUGiSOy9ta-Q-K7vHaL2fUi3cA57vD4GdpRc3r7vKOmtc3w0nTUrS4q153tg04LsBMg3RbMa06POSIpovRcM9rs5G9f4o8 Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 389e5ef34dcd47728ad0e57d77364f1e Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:41:36.447471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_389e5ef34dcd47728ad0e57d77364f1e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 389e5ef34dcd47728ad0e57d77364f1e Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-VolumesSnapshotsTestJSON-1343829817-project Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: fd6962beac3345d1901e977712c99ac8 Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1343829817-project Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'd46e92d8-ae88-46aa-93ea-d72654d1bd75'} Sep 01 16:41:36.449023 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. (HTTP 404) (Request-ID: req-20745574-752f-49c2-aee7-840a807f1b87) Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:36.450012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:41:36.451590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:41:36.453115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-16382f93-95e5-44fb-a4b7-9fc61742ac0f tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Returning 404 to user: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-16382f93-95e5-44fb-a4b7-9fc61742ac0f tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75" status: 404 len: 109 microversion: 2.1 time: 0.039933 Sep 01 16:41:36.454520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 494/986] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:41:36 2022] DELETE /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:36.457945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8b39675-5b76-4a9f-9aa2-9a1714874c06 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Calling method '.version_select at 0x7fe37d870430>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:36.486204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-e8b39675-5b76-4a9f-9aa2-9a1714874c06 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] HTTP exception thrown: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8b39675-5b76-4a9f-9aa2-9a1714874c06 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Request method failure captured: Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 HTTP/1.1 Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEOC0vIk866cpeYKwnL-OLXFLbeVU_W7PYqZfa_XUfH78Yq6uZUt0u76o1PadBWbPQt5Xlb07cnW1MA45NZUGiSOy9ta-Q-K7vHaL2fUi3cA57vD4GdpRc3r7vKOmtc3w0nTUrS4q153tg04LsBMg3RbMa06POSIpovRcM9rs5G9f4o8 Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: 389e5ef34dcd47728ad0e57d77364f1e Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:41:36.488211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_389e5ef34dcd47728ad0e57d77364f1e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389e5ef34dcd47728ad0e57d77364f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 389e5ef34dcd47728ad0e57d77364f1e Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1343829817 Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesSnapshotsTestJSON-1343829817-project Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: fd6962beac3345d1901e977712c99ac8 Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1343829817-project Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'd46e92d8-ae88-46aa-93ea-d72654d1bd75'} Sep 01 16:41:36.489872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. (HTTP 404) (Request-ID: req-0636f4a3-5f82-4402-9d5f-41516c1d813a) Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:36.490984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:41:36.492396 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:41:36.494105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8b39675-5b76-4a9f-9aa2-9a1714874c06 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] Returning 404 to user: Volume d46e92d8-ae88-46aa-93ea-d72654d1bd75 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e8b39675-5b76-4a9f-9aa2-9a1714874c06 tempest-VolumesSnapshotsTestJSON-1343829817 tempest-VolumesSnapshotsTestJSON-1343829817-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75" status: 404 len: 109 microversion: 2.1 time: 0.035456 Sep 01 16:41:36.495502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 493/987] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:41:36 2022] GET /compute/v2.1/os-volumes/d46e92d8-ae88-46aa-93ea-d72654d1bd75 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:48.999507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-651aaea1-ebfd-4906-927e-b26eabb9cde4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:49.001689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-651aaea1-ebfd-4906-927e-b26eabb9cde4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:49.007755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-651aaea1-ebfd-4906-927e-b26eabb9cde4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.008287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-651aaea1-ebfd-4906-927e-b26eabb9cde4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.008694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-651aaea1-ebfd-4906-927e-b26eabb9cde4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.009377 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-651aaea1-ebfd-4906-927e-b26eabb9cde4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.009860 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-651aaea1-ebfd-4906-927e-b26eabb9cde4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.010289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-651aaea1-ebfd-4906-927e-b26eabb9cde4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.040783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-651aaea1-ebfd-4906-927e-b26eabb9cde4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046751 Sep 01 16:41:49.041476 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 495/988] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:48 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:41:49.104399 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:49.105069 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:49.111743 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.112247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.112676 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.113370 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.113827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.114252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.139606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:41:49.487119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cb9760b0-f53e-4b84-90d0-6de44683a933 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 204 len: 0 microversion: 2.1 time: 0.387083 Sep 01 16:41:49.487938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 494/989] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:41:49 2022] DELETE /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:49.496212 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:49.496823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:49.502942 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.503453 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.503884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.504584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.505021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.505434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.647358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.656057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-476b80bc-053d-4e6c-9c26-3cd708ebd8aa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1674 microversion: 2.1 time: 0.163741 Sep 01 16:41:49.656637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 496/990] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:49 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:50.678478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:50.679418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:50.685980 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:50.686455 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:50.686884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:50.687598 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:50.688043 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:50.688463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:50.837203 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:50.841157 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bf961048-7d52-4299-bf56-d49cfde33cf2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1674 microversion: 2.1 time: 0.166784 Sep 01 16:41:50.842045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 495/991] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:50 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:51.864199 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:51.864859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:51.872621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.873098 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.873529 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.874227 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.874675 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.875105 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.098233 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:52.118012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7643704d-cd1f-44ce-8b67-819b0f7cf7eb tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1674 microversion: 2.1 time: 0.255160 Sep 01 16:41:52.118012 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 497/992] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:51 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:52.341968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-282226b9-8105-4ec1-bc86-a4211353d50e req-d2d35fa1-e011-450f-b364-27bf67a309c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9c562a4-a89a-4fb1-9f85-e9efa1183ff1", "name": "network-vif-deleted", "tag": "ccc88b9b-88ad-4e4f-9efa-bcefeca59f9e"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:52.353508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-282226b9-8105-4ec1-bc86-a4211353d50e req-d2d35fa1-e011-450f-b364-27bf67a309c7 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.353950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-282226b9-8105-4ec1-bc86-a4211353d50e req-d2d35fa1-e011-450f-b364-27bf67a309c7 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.354314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-282226b9-8105-4ec1-bc86-a4211353d50e req-d2d35fa1-e011-450f-b364-27bf67a309c7 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.365983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-282226b9-8105-4ec1-bc86-a4211353d50e req-d2d35fa1-e011-450f-b364-27bf67a309c7 service nova] Creating event network-vif-deleted:ccc88b9b-88ad-4e4f-9efa-bcefeca59f9e for instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 on hv-cinder-83602 Sep 01 16:41:52.377227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-282226b9-8105-4ec1-bc86-a4211353d50e req-d2d35fa1-e011-450f-b364-27bf67a309c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035054 Sep 01 16:41:52.377227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 496/993] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:53.138330 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:53.139620 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:53.146907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.147457 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.153455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.153455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.153455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.153455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.187593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.188356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.189112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.189762 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lazy-loading 'fault' on Instance uuid c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:41:53.240430 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:53.252401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-11711a4d-cdc1-4a1d-a167-a9f9966c5fe6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 200 len: 1328 microversion: 2.1 time: 0.117938 Sep 01 16:41:53.253499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 498/994] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:53 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:54.274425 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:54.275247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:54.283447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:54.283967 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:54.284427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:54.285157 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:54.285644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:54.286106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:54.301655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] HTTP exception thrown: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Request method failure captured: Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 HTTP/1.1 Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7Hufjvuzg0MlUpGchlhUdKmcwC-6ghPWMG6-QE-KzERxQoU60gi542NDyqs0BYwcCweLi-bkWIZpnoGLqF9aZnucFAfU70l5wQJ4ieLVwgWxnjBjtUHsUGJbFoHRFFhPfOToAnKWsP-TYuTRHZh-o1BxoT5Fx2g5t5n55b0r45Fkc Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:41:54.303395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c787c684c86144c792d9afc457ac3212", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 21e6ff7908e84a5994a51be0cfc82414 Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:41:54.305033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'c9c562a4-a89a-4fb1-9f85-e9efa1183ff1'} Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:41:54.306078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:41:54.307927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:41:54.310341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Returning 404 to user: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:41:54.310341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-49aced11-95f1-4106-9ec0-5f14e9614aae tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 404 len: 111 microversion: 2.1 time: 0.034701 Sep 01 16:41:54.310341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 497/995] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:54 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:54.314731 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-05bd94d9-c316-4de1-bf59-32a03202e53d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '.version_select at 0x7fe37a0a6ee0>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:54.393108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-05bd94d9-c316-4de1-bf59-32a03202e53d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100385934" status: 202 len: 0 microversion: 2.1 time: 0.082082 Sep 01 16:41:54.393692 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 499/996] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 1 16:41:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100385934 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:41:55.154437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9234c476-c857-4844-b5fe-73607cf0de1a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'create', calling method: .version_select at 0x7fe37d7ecaf0>, body: {"keypair": {"name": "tempest-keypair-1149890991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrlZ1Yuz6IcGmGnBQ2V++EG/RrHrHLJsNZfhPCp432w35mE3v6ZPm2tTymXYxpduoTLxmaqZf6d8e2yows4fVWUSd04l51/bx5HXAvnjb50My5NsHfHRgREmIfo/Q7qoA=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:55.170479 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-9234c476-c857-4844-b5fe-73607cf0de1a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Getting quotas for project c787c684c86144c792d9afc457ac3212. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:55.174385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-9234c476-c857-4844-b5fe-73607cf0de1a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Getting quotas for user 21e6ff7908e84a5994a51be0cfc82414 and project c787c684c86144c792d9afc457ac3212. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:55.263627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9234c476-c857-4844-b5fe-73607cf0de1a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112519 Sep 01 16:41:55.266285 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 498/997] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:41:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:57.701863 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1454908328", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34674731-e9de-430b-8790-1c8cae27644d"}], "security_groups": [{"name": "tempest-securitygroup--721806208"}], "key_name": "tempest-keypair-1149890991", "user_data": "}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:57.815302 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] validate_networks() for [('34674731-e9de-430b-8790-1c8cae27644d', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:41:58.527996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:41:58.528492 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:41:58.529064 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:41:58.529549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:41:58.530033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:41:58.539045 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.539667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.540168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.540966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.541494 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.541989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.560290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Getting quotas for project c787c684c86144c792d9afc457ac3212. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:58.564245 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Getting quotas for user 21e6ff7908e84a5994a51be0cfc82414 and project c787c684c86144c792d9afc457ac3212. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:58.576389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:41:58.578701 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:41:58.744364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ff47897f-7a8b-4613-95e0-aab5595b7b4a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.046757 Sep 01 16:41:58.745235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 500/998] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:41:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:41:58.757293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be63291e-8e7a-496d-b208-2e70c33a924f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:58.757910 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be63291e-8e7a-496d-b208-2e70c33a924f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:58.818742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be63291e-8e7a-496d-b208-2e70c33a924f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:58.827045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be63291e-8e7a-496d-b208-2e70c33a924f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1238 microversion: 2.1 time: 0.074196 Sep 01 16:41:58.827675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 499/999] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:58 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:59.848783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:59.849966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:59.856095 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.857103 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.857548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:59.858248 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.858696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.859120 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:59.921065 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:59.928686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5cc8f93c-aaf8-4608-b118-0eb9b60e9f9e tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1234 microversion: 2.1 time: 0.084610 Sep 01 16:41:59.929252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 501/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:59 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:00.950210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:00.951477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:00.958213 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:00.958707 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:00.959184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:00.959902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:00.960606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:00.961333 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:01.028930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:01.040792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1ec16283-42c3-4f58-9849-5e60c7f6cfea tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1298 microversion: 2.1 time: 0.093609 Sep 01 16:42:01.041700 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 500/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:00 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:02.062380 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:02.063103 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:02.069671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:02.070157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:02.070585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:02.071322 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:02.071774 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:02.072192 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:02.280871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:02.289308 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b4f0b7b2-b5f5-498d-9bab-f841cce2c912 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.231187 Sep 01 16:42:02.289881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 502/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:02 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:02.704861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-5eef2580-e365-4e9a-a3f2-8acbd2af99eb req-2a84a7d9-ebf0-4c03-aaa5-e0ff054d5ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e4fec9-b6c8-4535-a00d-1df0a58e9019", "tag": "f4bb15e3-c3b8-43c9-a3c3-216dfa593471"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:02.716945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-5eef2580-e365-4e9a-a3f2-8acbd2af99eb req-2a84a7d9-ebf0-4c03-aaa5-e0ff054d5ae6 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:02.717200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-5eef2580-e365-4e9a-a3f2-8acbd2af99eb req-2a84a7d9-ebf0-4c03-aaa5-e0ff054d5ae6 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:02.717677 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-5eef2580-e365-4e9a-a3f2-8acbd2af99eb req-2a84a7d9-ebf0-4c03-aaa5-e0ff054d5ae6 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:02.736180 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-5eef2580-e365-4e9a-a3f2-8acbd2af99eb req-2a84a7d9-ebf0-4c03-aaa5-e0ff054d5ae6 service nova] Creating event network-changed:f4bb15e3-c3b8-43c9-a3c3-216dfa593471 for instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 on hv-cinder-83602 Sep 01 16:42:02.744310 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-5eef2580-e365-4e9a-a3f2-8acbd2af99eb req-2a84a7d9-ebf0-4c03-aaa5-e0ff054d5ae6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040133 Sep 01 16:42:02.744964 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 501/1003] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:03.309842 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:03.310455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:03.317261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:03.317759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:03.318189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:03.318875 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:03.319460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:03.319919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:03.533775 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:03.541637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c07c9eb9-fe25-4fe4-9a73-a624ab602ea7 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.235695 Sep 01 16:42:03.544068 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 503/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:03 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:04.563766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:04.564458 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:04.571321 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:04.571802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:04.572229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:04.572952 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:04.573433 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:04.573851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:04.708761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:04.717606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6c8537e8-901c-4572-b7c5-e3bb13ae3b19 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.158379 Sep 01 16:42:04.718263 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 502/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:04 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:05.739695 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:05.740367 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:05.746817 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:05.747333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:05.747810 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:05.748816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:05.749267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:05.749685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:05.887915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:05.896580 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-742ff40d-2cfd-43fa-b25a-ab8a20e5e43d tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.160817 Sep 01 16:42:05.897138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 504/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:05 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:06.917606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:06.918505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:06.925593 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:06.926086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:06.926602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:06.927228 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:06.933422 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:06.933422 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:07.058522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:07.066385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c0e4e5cc-f068-4db4-9a50-c641cafca283 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.152865 Sep 01 16:42:07.066943 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 503/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:06 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:08.087862 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:08.088471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:08.094990 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.095501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.095939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.096680 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.097086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.097507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.234761 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:08.242515 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3d7bb8ce-4d9e-4b0f-a60e-1d6ad096efb1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.158832 Sep 01 16:42:08.243084 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 505/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:08 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:08.833440 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-ebd13ad0-fe36-401b-a35c-b12ac37c0a1f req-a94093ee-8a8e-466f-bf3d-7491831fb9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e4fec9-b6c8-4535-a00d-1df0a58e9019", "name": "network-vif-plugged", "status": "completed", "tag": "f4bb15e3-c3b8-43c9-a3c3-216dfa593471"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:08.839223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:08.845398 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ebd13ad0-fe36-401b-a35c-b12ac37c0a1f req-a94093ee-8a8e-466f-bf3d-7491831fb9c1 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:08.845938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ebd13ad0-fe36-401b-a35c-b12ac37c0a1f req-a94093ee-8a8e-466f-bf3d-7491831fb9c1 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:08.846358 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ebd13ad0-fe36-401b-a35c-b12ac37c0a1f req-a94093ee-8a8e-466f-bf3d-7491831fb9c1 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:08.857863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-ebd13ad0-fe36-401b-a35c-b12ac37c0a1f req-a94093ee-8a8e-466f-bf3d-7491831fb9c1 service nova] Creating event network-vif-plugged:f4bb15e3-c3b8-43c9-a3c3-216dfa593471 for instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 on hv-cinder-83602 Sep 01 16:42:08.865100 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-ebd13ad0-fe36-401b-a35c-b12ac37c0a1f req-a94093ee-8a8e-466f-bf3d-7491831fb9c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 Sep 01 16:42:08.865100 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 504/1009] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:09.263596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:09.264200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:09.268317 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:09.269250 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=6 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:09.273602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.274081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.274510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.275228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.275717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.276132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.409896 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:09.417463 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5b29b649-4327-49ff-a706-9a80ff32d554 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.157918 Sep 01 16:42:09.418030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 506/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:09 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:10.439501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:10.440202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:10.446394 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.448535 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.448535 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.448535 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.448535 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.448871 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.582144 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:10.589976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-21b6c8fd-b0f2-434e-b237-60d08f7929e1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.155810 Sep 01 16:42:10.590540 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 505/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:10 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:11.612673 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:11.613277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:11.619856 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:11.620346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:11.620759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:11.621431 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:11.621875 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:11.622290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:11.752459 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:11.760066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7d4148fd-500d-4aba-aee0-8fbb41ebb314 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.152527 Sep 01 16:42:11.760637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 507/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:11 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:12.780179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:12.780810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:12.788766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.789235 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.789663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.790339 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.790811 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.791246 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.919757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:12.928087 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7540d1b4-3e5e-48ec-9086-5d38e8c81bef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.151693 Sep 01 16:42:12.928585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 506/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:12 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:13.948886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:13.949512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:13.957115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:13.957592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:13.958019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:13.958697 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:13.959136 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:13.959577 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:14.094061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:14.102699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8d8f2f11-9582-4c7d-afc8-4791ed648005 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.157653 Sep 01 16:42:14.103291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 508/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:13 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:15.124468 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:15.133229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:15.133229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.133229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.133229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.133727 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.134151 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.134569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.279306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:15.287563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c462f94b-fe92-4f11-83f6-4d3e86489d05 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.166983 Sep 01 16:42:15.288128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 507/1015] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:15 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:16.308206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:16.308809 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:16.316021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:16.316496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:16.316920 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:16.317597 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:16.318046 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:16.318461 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:16.450073 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:16.458811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0c9e6e2e-0298-4242-9b58-6cc02b475f20 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.154420 Sep 01 16:42:16.459412 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 509/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:16 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:17.479622 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:17.480389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:17.487048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:17.487867 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:17.488047 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:17.488639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:17.489087 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:17.489502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:17.622733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:17.631489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-154e840d-ca30-4f89-9c4b-66258d1bc1ef tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.155614 Sep 01 16:42:17.632064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 508/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:17 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:18.655625 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:18.656216 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:18.663578 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:18.664055 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:18.664489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:18.665176 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:18.665625 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:18.666041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:18.797812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:18.805521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4adc0e9c-db07-453d-9c71-3f83b95e3e7a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1363 microversion: 2.1 time: 0.153945 Sep 01 16:42:18.806092 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 510/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:18 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:19.826576 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:19.827209 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:19.829783 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:19.834641 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.835127 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.835592 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.836302 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.836759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.837184 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.840076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:19.974006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:19.982211 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7cb9f20f-1e2d-4215-9232-9937707bc7a5 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1550 microversion: 2.1 time: 0.159560 Sep 01 16:42:19.982811 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 509/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:19 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:20.008426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0056339e-dbef-4247-95e0-ce4f4b324883 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:20.009054 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0056339e-dbef-4247-95e0-ce4f4b324883 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:20.011493 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:20.016421 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0056339e-dbef-4247-95e0-ce4f4b324883 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:20.016907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0056339e-dbef-4247-95e0-ce4f4b324883 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:20.017434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0056339e-dbef-4247-95e0-ce4f4b324883 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.018133 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0056339e-dbef-4247-95e0-ce4f4b324883 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:20.018586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0056339e-dbef-4247-95e0-ce4f4b324883 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:20.019047 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0056339e-dbef-4247-95e0-ce4f4b324883 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.021686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=89 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:20.101569 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0056339e-dbef-4247-95e0-ce4f4b324883 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097022 Sep 01 16:42:20.102198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 511/1020] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 16:42:20 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:21.112785 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-bce68dce-0bb0-4353-8ee6-0fd5e54ae28e req-80b0185c-dc3c-4db6-9721-c9a776ae4432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e4fec9-b6c8-4535-a00d-1df0a58e9019", "tag": "f4bb15e3-c3b8-43c9-a3c3-216dfa593471"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:21.124156 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-bce68dce-0bb0-4353-8ee6-0fd5e54ae28e req-80b0185c-dc3c-4db6-9721-c9a776ae4432 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:21.124636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-bce68dce-0bb0-4353-8ee6-0fd5e54ae28e req-80b0185c-dc3c-4db6-9721-c9a776ae4432 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:21.125075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-bce68dce-0bb0-4353-8ee6-0fd5e54ae28e req-80b0185c-dc3c-4db6-9721-c9a776ae4432 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:21.136689 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-bce68dce-0bb0-4353-8ee6-0fd5e54ae28e req-80b0185c-dc3c-4db6-9721-c9a776ae4432 service nova] Creating event network-changed:f4bb15e3-c3b8-43c9-a3c3-216dfa593471 for instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 on hv-cinder-83602 Sep 01 16:42:21.142364 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-bce68dce-0bb0-4353-8ee6-0fd5e54ae28e req-80b0185c-dc3c-4db6-9721-c9a776ae4432 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034056 Sep 01 16:42:21.142974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 510/1021] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:41.933543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3367bb9f-a160-46e4-a8a4-d5c7291bbd35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:41.934113 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3367bb9f-a160-46e4-a8a4-d5c7291bbd35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:41.941720 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3367bb9f-a160-46e4-a8a4-d5c7291bbd35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.942202 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3367bb9f-a160-46e4-a8a4-d5c7291bbd35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.942631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3367bb9f-a160-46e4-a8a4-d5c7291bbd35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.943410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3367bb9f-a160-46e4-a8a4-d5c7291bbd35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.943868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3367bb9f-a160-46e4-a8a4-d5c7291bbd35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.944288 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3367bb9f-a160-46e4-a8a4-d5c7291bbd35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.969060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3367bb9f-a160-46e4-a8a4-d5c7291bbd35 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/ips" status: 200 len: 149 microversion: 2.1 time: 0.040174 Sep 01 16:42:41.969637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 512/1022] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:42:41 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:44.711445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:44.716436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e1c1024-af9b-4d68-8de5-2a2bb818daac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "236e3c47-f8c4-4baa-81c1-729dc68fa21f"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:44.719001 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e1c1024-af9b-4d68-8de5-2a2bb818daac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:44.725967 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e1c1024-af9b-4d68-8de5-2a2bb818daac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:44.726518 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e1c1024-af9b-4d68-8de5-2a2bb818daac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:44.731137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e1c1024-af9b-4d68-8de5-2a2bb818daac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:44.731137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e1c1024-af9b-4d68-8de5-2a2bb818daac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:44.731137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e1c1024-af9b-4d68-8de5-2a2bb818daac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:44.731137 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e1c1024-af9b-4d68-8de5-2a2bb818daac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:45.483864 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e1c1024-af9b-4d68-8de5-2a2bb818daac tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.773501 Sep 01 16:42:45.484613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 511/1023] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:42:44 2022] POST /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:53.120726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-21a69ddb-5679-4044-9b23-750c9a507e7f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:53.121410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-21a69ddb-5679-4044-9b23-750c9a507e7f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:53.126601 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=7 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:53.133943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-21a69ddb-5679-4044-9b23-750c9a507e7f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:53.133943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-21a69ddb-5679-4044-9b23-750c9a507e7f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:53.133943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-21a69ddb-5679-4044-9b23-750c9a507e7f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:53.133943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-21a69ddb-5679-4044-9b23-750c9a507e7f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:53.134505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-21a69ddb-5679-4044-9b23-750c9a507e7f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:53.134505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-21a69ddb-5679-4044-9b23-750c9a507e7f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:53.158227 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-21a69ddb-5679-4044-9b23-750c9a507e7f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/ips" status: 200 len: 151 microversion: 2.20 time: 0.042140 Sep 01 16:42:53.159081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 513/1024] 10.222.0.16 () {60 vars in 1289 bytes} [Thu Sep 1 16:42:53 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:42:54.128508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "236e3c47-f8c4-4baa-81c1-729dc68fa21f"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:54.131091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:54.137341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:54.137832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:54.138259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:54.138950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:54.139439 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:54.140441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:54.221587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Invalid volume: volume 236e3c47-f8c4-4baa-81c1-729dc68fa21f is already attached to instances: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: POST /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments HTTP/1.1 Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 74 Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:42:54.223350 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {"volumeAttachment": {"volumeId": "236e3c47-f8c4-4baa-81c1-729dc68fa21f"}} Sep 01 16:42:54.225082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Invalid volume: volume 236e3c47-f8c4-4baa-81c1-729dc68fa21f is already attached to instances: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'server_id': '65d5141e-06e1-45b2-ad7a-11ae9de1a0bf', 'body': {'volumeAttachment': {'volumeId': '236e3c47-f8c4-4baa-81c1-729dc68fa21f'}}} Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 236e3c47-f8c4-4baa-81c1-729dc68fa21f is already attached to instances: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:42:54.226169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 236e3c47-f8c4-4baa-81c1-729dc68fa21f is already attached to instances: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:54.227730 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:54.229312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:54.229312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:54.229312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:54.229312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 236e3c47-f8c4-4baa-81c1-729dc68fa21f is already attached to instances: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf Sep 01 16:42:54.229312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:42:54.229312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 400 to user: Invalid volume: volume 236e3c47-f8c4-4baa-81c1-729dc68fa21f is already attached to instances: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:54.229312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b7a7dc65-9895-4aed-8e65-9d7bfc917b30 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102094 Sep 01 16:42:54.229312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 512/1025] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:42:54 2022] POST /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:42:54.293366 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:54.293931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:54.302104 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:54.302590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:54.303020 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:54.303724 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:54.304169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:54.304586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:54.390416 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lazy-loading 'services' on Instance uuid 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:54.653251 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-65f8ff85-a84d-4a9f-aaec-69895db19c2d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments/236e3c47-f8c4-4baa-81c1-729dc68fa21f" status: 202 len: 0 microversion: 2.1 time: 0.364389 Sep 01 16:42:54.653886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 514/1026] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:42:54 2022] DELETE /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments/236e3c47-f8c4-4baa-81c1-729dc68fa21f => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:54.665157 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d2f237be-4497-4562-b9d7-d44b8a0b4db2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:54.667484 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d2f237be-4497-4562-b9d7-d44b8a0b4db2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:54.676532 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2f237be-4497-4562-b9d7-d44b8a0b4db2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:54.677271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2f237be-4497-4562-b9d7-d44b8a0b4db2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:54.677938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2f237be-4497-4562-b9d7-d44b8a0b4db2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:54.679012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2f237be-4497-4562-b9d7-d44b8a0b4db2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:54.679727 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2f237be-4497-4562-b9d7-d44b8a0b4db2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:54.680366 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2f237be-4497-4562-b9d7-d44b8a0b4db2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:54.713216 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d2f237be-4497-4562-b9d7-d44b8a0b4db2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054039 Sep 01 16:42:54.713949 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 513/1027] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:54 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:55.727893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-28085b3e-1a3f-49a3-95f3-d24aee1869ed tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:55.730514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-28085b3e-1a3f-49a3-95f3-d24aee1869ed tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:55.738626 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28085b3e-1a3f-49a3-95f3-d24aee1869ed tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.739095 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28085b3e-1a3f-49a3-95f3-d24aee1869ed tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.739551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28085b3e-1a3f-49a3-95f3-d24aee1869ed tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.740244 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28085b3e-1a3f-49a3-95f3-d24aee1869ed tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:55.740688 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28085b3e-1a3f-49a3-95f3-d24aee1869ed tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:55.741103 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28085b3e-1a3f-49a3-95f3-d24aee1869ed tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:55.773317 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-28085b3e-1a3f-49a3-95f3-d24aee1869ed tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051115 Sep 01 16:42:55.773876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 515/1028] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:55 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:56.347102 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:56.347998 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:56.355678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.356154 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.356585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.357267 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.357846 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.358819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.381955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lazy-loading 'flavor' on Instance uuid a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:56.786526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fb8a3239-b209-49ff-9320-71dae8c4985c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:56.788750 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fb8a3239-b209-49ff-9320-71dae8c4985c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:56.795076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a3239-b209-49ff-9320-71dae8c4985c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.795640 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a3239-b209-49ff-9320-71dae8c4985c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.796412 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a3239-b209-49ff-9320-71dae8c4985c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.797165 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a3239-b209-49ff-9320-71dae8c4985c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.797621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a3239-b209-49ff-9320-71dae8c4985c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.798045 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a3239-b209-49ff-9320-71dae8c4985c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.824045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d1437b8c-e4ec-4e85-922b-7368fa2c448f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/action" status: 202 len: 0 microversion: 2.20 time: 0.483276 Sep 01 16:42:56.824783 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 514/1029] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 1 16:42:56 2022] POST /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:42:56.831782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fb8a3239-b209-49ff-9320-71dae8c4985c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048642 Sep 01 16:42:56.832517 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 516/1030] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:56 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 16:42:56.833697 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:56.834379 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:56.845295 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.845295 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.845295 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.845295 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.845635 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.845635 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.898115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:56.898115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:56.902551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.903039 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.903504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.904273 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:56.904758 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:56.905192 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:56.938053 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:42:56.985723 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:56.993920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:56.995398 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:56.996549 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b3e1e6c4-595b-4b9e-925a-b0a3a7247476 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.167003 Sep 01 16:42:56.997106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 515/1031] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:56 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:42:57.189215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-87107ae8-da82-40e1-ac18-734850857e56 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 204 len: 0 microversion: 2.1 time: 0.296957 Sep 01 16:42:57.189749 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 517/1032] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:56 2022] DELETE /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:42:57.198097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:57.198715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:57.204906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.205383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.205866 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.206550 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:57.207001 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:57.207450 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:57.337832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:57.346478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e8a3169a-9c0d-4820-8a67-35c8eb952b97 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1680 microversion: 2.1 time: 0.152262 Sep 01 16:42:57.347041 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 516/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:57 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:58.021213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:58.021878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:58.028318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.028819 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.029249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.030616 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.031082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.031522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.174488 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:58.182585 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:58.184095 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:58.185235 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a0d50b18-d6c4-47e2-98b5-9f202b2b63e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.168663 Sep 01 16:42:58.185838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 518/1034] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:58 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:58.372832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:58.374083 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:58.380900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.381381 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.381811 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.382539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:58.382989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:58.383439 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:58.519195 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:58.527080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-790eb003-815d-422d-9672-0340adfb19ff tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1680 microversion: 2.1 time: 0.158070 Sep 01 16:42:58.530163 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 517/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:58 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:59.209038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:59.209678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:59.215912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.216385 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.216808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.217895 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.218351 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.218718 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.354061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:59.362950 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:59.364504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:59.365666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-66a5d345-11d4-4c85-be49-9a9824619d9a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.160720 Sep 01 16:42:59.366229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 519/1036] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:42:59 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:42:59.549262 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:59.554492 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:59.557154 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.557741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.558271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.559070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:59.559920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:59.560411 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:59.798464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:59.806663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f59acd34-4282-4850-b25c-4e91f856c031 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1680 microversion: 2.1 time: 0.261587 Sep 01 16:42:59.807580 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 518/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:59 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:00.394109 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:00.395300 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:00.410215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.410215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.410215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.410215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.410678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.410678 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.437721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-1561c15b-06d4-4bb7-a370-25e4f3ba153d req-197a38b1-fe7f-49f8-bdef-13e85b69b424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d5141e-06e1-45b2-ad7a-11ae9de1a0bf", "name": "network-vif-deleted", "tag": "1f17da61-a2b1-4c49-b455-712316c7f8c4"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:00.447565 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-1561c15b-06d4-4bb7-a370-25e4f3ba153d req-197a38b1-fe7f-49f8-bdef-13e85b69b424 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.448334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-1561c15b-06d4-4bb7-a370-25e4f3ba153d req-197a38b1-fe7f-49f8-bdef-13e85b69b424 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.448923 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-1561c15b-06d4-4bb7-a370-25e4f3ba153d req-197a38b1-fe7f-49f8-bdef-13e85b69b424 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.462475 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-1561c15b-06d4-4bb7-a370-25e4f3ba153d req-197a38b1-fe7f-49f8-bdef-13e85b69b424 service nova] Creating event network-vif-deleted:1f17da61-a2b1-4c49-b455-712316c7f8c4 for instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf on hv-cinder-83602 Sep 01 16:43:00.468826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-1561c15b-06d4-4bb7-a370-25e4f3ba153d req-197a38b1-fe7f-49f8-bdef-13e85b69b424 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035420 Sep 01 16:43:00.470173 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 519/1038] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:43:00.590851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:00.601616 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:00.604599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:00.604599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-15af8888-9be3-4fef-a6f3-5f5303b330a8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.215827 Sep 01 16:43:00.606130 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 520/1039] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:00 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:00.828807 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:00.829716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:00.836302 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.836753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.837393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.838769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.838769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.839029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.875289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:00.876066 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:00.876504 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:00.876951 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lazy-loading 'fault' on Instance uuid 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:43:00.923502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:00.930857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1f3c1de1-1389-41e9-b375-fdd349948416 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1332 microversion: 2.1 time: 0.107550 Sep 01 16:43:00.931463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 520/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:00 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:01.629093 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:01.629861 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:01.636372 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:01.636854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:01.637277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:01.637962 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:01.639247 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:01.640035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:01.777115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:01.786351 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:01.787814 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:01.788968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9b60445a-50dd-4e67-b514-82e42f32ff51 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.163956 Sep 01 16:43:01.789519 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 521/1041] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:01 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:01.952732 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:01.953284 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:01.960203 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:01.960691 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:01.961133 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:01.961828 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:01.962299 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:01.962732 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:01.996166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:01.996533 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:01.996960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:01.997445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lazy-loading 'fault' on Instance uuid 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:43:02.047249 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:02.055386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-14afedd0-ad01-4a3e-9e6e-626ff07be973 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 200 len: 1332 microversion: 2.1 time: 0.107124 Sep 01 16:43:02.060734 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 521/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:01 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:02.812426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:02.813034 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:02.819444 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:02.819923 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:02.820360 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:02.821039 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:02.821487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:02.821904 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:02.960146 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:02.968143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:02.969650 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:02.970767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-af06a893-1d88-423e-914c-b5ae177b56bb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.162773 Sep 01 16:43:02.971373 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 522/1043] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:02 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:03.077778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:03.078531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:03.085242 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:03.085724 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:03.086155 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:03.086918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:03.087357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:03.087784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:03.101297 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf HTTP/1.1 Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:43:03.102930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:43:03.104665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '65d5141e-06e1-45b2-ad7a-11ae9de1a0bf'} Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:03.105658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:43:03.107222 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:43:03.108842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:03.108842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-94d573b6-b679-4e45-bd56-5148d6d7104b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 404 len: 111 microversion: 2.1 time: 0.031333 Sep 01 16:43:03.108842 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 522/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:03 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:03.113493 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d873b8f7-76e2-4ca0-b923-c26017e4e8c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '.version_select at 0x7fe379ff1670>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:03.218765 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d873b8f7-76e2-4ca0-b923-c26017e4e8c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820463469" status: 202 len: 0 microversion: 2.1 time: 0.108943 Sep 01 16:43:03.219387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 523/1045] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 1 16:43:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820463469 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:43:03.982945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7a2b1075-7b86-44f5-a56b-448f1ef79884 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: .version_select at 0x7fe37d8cb820>, body: {"keypair": {"name": "tempest-keypair-1551677473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaEopZLnlStdtSOQJ/zqRl815jeicve4x83tUXnguTEy7Cu4uUcMDzwwxDAaaA4l6LYvhHVMSNxU2khMfDcRgRw6wUwc71qruTWcyAU0RlCEt/cEsAR8KuPeCCww5MHiQ=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:03.994387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:03.995167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:03.999651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-7a2b1075-7b86-44f5-a56b-448f1ef79884 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for project a994270b8e1f43328b827696f9d89bb0. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:43:04.007926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:04.007926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:04.007926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:04.008186 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-7a2b1075-7b86-44f5-a56b-448f1ef79884 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for user 8a45ee95cf5947c49584ff403facaff7 and project a994270b8e1f43328b827696f9d89bb0. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:43:04.008283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:04.008283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:04.008283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:04.162324 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7a2b1075-7b86-44f5-a56b-448f1ef79884 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183351 Sep 01 16:43:04.163071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 523/1046] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:43:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:04.363685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:04.375067 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:04.376880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:04.378207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c43d65b1-6bb3-4e27-b843-37f7ee653f7d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.388359 Sep 01 16:43:04.379112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 524/1047] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:03 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:05.402101 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:05.402749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:05.412511 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:05.413113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:05.413660 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:05.414575 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:05.415335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:05.422615 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:05.562478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:05.565158 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:05.572965 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:05.574606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:05.575896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b23f704e-478e-446b-973b-18cf51ea5e47 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.177859 Sep 01 16:43:05.577365 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 524/1048] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:05 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:06.605888 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:06.606885 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:06.613681 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:06.614167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:06.614591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:06.615318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:06.627454 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:06.627454 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:06.648920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-628316072", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1eb71281-5889-42b9-a660-ae574bf041ed"}], "security_groups": [{"name": "tempest-securitygroup--921762062"}], "key_name": "tempest-keypair-1551677473", "user_data": "}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:06.784366 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] validate_networks() for [('1eb71281-5889-42b9-a660-ae574bf041ed', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:43:06.822341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:06.830969 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:06.832534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:06.833802 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7958be27-ea13-46c1-b194-ecbf4cae6658 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.232629 Sep 01 16:43:06.834643 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 525/1049] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:06 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:07.244379 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:43:07.245103 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:43:07.245794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:43:07.246305 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:43:07.247028 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:43:07.257340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:07.257986 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:07.258542 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:07.259651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:07.260634 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:07.261207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:07.279834 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for project a994270b8e1f43328b827696f9d89bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:43:07.283478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Getting quotas for user 8a45ee95cf5947c49584ff403facaff7 and project a994270b8e1f43328b827696f9d89bb0. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:43:07.296031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:43:07.298558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:43:07.402757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3751b0c6-279f-43cb-90cd-3bba9a1d64a2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.758175 Sep 01 16:43:07.403459 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 525/1050] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:43:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:43:07.414807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2041abfc-16c0-453e-ba83-8dddd67fc389 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:07.415534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2041abfc-16c0-453e-ba83-8dddd67fc389 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:07.472943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2041abfc-16c0-453e-ba83-8dddd67fc389 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:07.483825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2041abfc-16c0-453e-ba83-8dddd67fc389 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1241 microversion: 2.1 time: 0.072478 Sep 01 16:43:07.486015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 526/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:07 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:07.859285 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:07.859949 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:07.868652 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:07.869161 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:07.869597 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:07.870289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:07.870744 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:07.871177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:08.015679 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:08.023309 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:08.024794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:08.025985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f46c8327-cf9a-4e7f-871d-38b53ed39048 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.171703 Sep 01 16:43:08.026531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 526/1052] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:07 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:08.516883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:08.517832 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:08.527721 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:08.528920 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:08.533547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:08.533547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:08.533547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:08.533547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:08.632111 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:08.644292 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a6e4e492-9fad-40cc-a725-03d8b74993b3 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1245 microversion: 2.1 time: 0.132024 Sep 01 16:43:08.645405 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 527/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:08 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1245 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:09.051121 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:09.051851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:09.058608 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:09.059087 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:09.059549 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:09.061145 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:09.061648 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:09.062065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:09.268490 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:09.276865 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:09.278317 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:09.280119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-222b6477-61ff-49f9-ad6e-b482d42b3b60 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.233590 Sep 01 16:43:09.280686 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 527/1054] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:09 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:09.676681 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:09.677555 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:09.684348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:09.685455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:09.686233 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:09.687085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:09.687893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:09.688499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:09.783343 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:09.788340 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ef55a4f3-2f41-4034-a24c-7dfe345c73e5 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1301 microversion: 2.1 time: 0.115269 Sep 01 16:43:09.803813 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 528/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:09 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1301 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:10.304262 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:10.305128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:10.312739 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:10.313417 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:10.313955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:10.314757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:10.315445 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:10.316042 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:10.476731 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:10.491015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:10.493466 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:10.494792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-80ef0eb3-aefb-4e8e-bc21-1ae2567753b1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.194935 Sep 01 16:43:10.495397 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 528/1056] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:10 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:10.816507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:10.818005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:10.826626 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:10.827328 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:10.828036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:10.829168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:10.830061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:10.830966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:10.858292 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:11.101134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:11.113606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ece34c16-1ce5-4db7-8d14-5fd6baef0743 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1366 microversion: 2.1 time: 0.301990 Sep 01 16:43:11.114660 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 529/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:10 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:11.520274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:11.521456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:11.529781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:11.530490 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:11.531075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:11.531872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:11.532368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:11.532849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:11.664166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-f36a39d0-02fe-4ff5-b307-c80c03dbc802 req-fb1f73f0-3463-482f-912d-1f1216631355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aca35b2-1f66-49bb-b9c2-7653ef1e83fd", "tag": "1f8ad264-6f25-4cb8-8762-f0b82941a4c4"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:11.678113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:11.688684 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:11.690400 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:11.691679 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-de894f0f-db9d-42db-a0f0-008ef5907ddc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.176681 Sep 01 16:43:11.692290 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 529/1058] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:11 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:11.702940 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f36a39d0-02fe-4ff5-b307-c80c03dbc802 req-fb1f73f0-3463-482f-912d-1f1216631355 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:11.703693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f36a39d0-02fe-4ff5-b307-c80c03dbc802 req-fb1f73f0-3463-482f-912d-1f1216631355 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:11.704558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-f36a39d0-02fe-4ff5-b307-c80c03dbc802 req-fb1f73f0-3463-482f-912d-1f1216631355 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:11.723883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-f36a39d0-02fe-4ff5-b307-c80c03dbc802 req-fb1f73f0-3463-482f-912d-1f1216631355 service nova] Creating event network-changed:1f8ad264-6f25-4cb8-8762-f0b82941a4c4 for instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd on hv-cinder-83602 Sep 01 16:43:11.732818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-f36a39d0-02fe-4ff5-b307-c80c03dbc802 req-fb1f73f0-3463-482f-912d-1f1216631355 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073281 Sep 01 16:43:11.733694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 530/1059] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:43:12.138442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:12.138978 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:12.145902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:12.146391 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:12.146820 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:12.147594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:12.148070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:12.148528 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:12.309702 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:12.319529 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5c22a7c3-4666-4d51-86f0-3c98f4706e92 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1366 microversion: 2.1 time: 0.185932 Sep 01 16:43:12.320256 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 530/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:12 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:12.854785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:12.855516 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:12.862510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:12.862991 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:12.863445 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:12.864135 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:12.864583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:12.865005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:13.002425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:13.013465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:13.015635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:13.016943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-478d7e9d-2880-43fd-b551-cdbd1253edc4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.306555 Sep 01 16:43:13.017507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 531/1061] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:12 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:13.342092 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:13.342710 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:13.349563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:13.350063 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:13.350497 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:13.351289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:13.351745 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:13.352167 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:13.487506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:13.495292 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a703722f-c7bf-480d-b52a-04077df676bd tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1366 microversion: 2.1 time: 0.157075 Sep 01 16:43:13.495876 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 531/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:13 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:14.042894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:14.044518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:14.051468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:14.051926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:14.052359 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:14.053052 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:14.053497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:14.053918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:14.193290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:14.207323 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:14.210137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:14.213836 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dcfd7863-d9a2-4d52-b674-dbb693f5a39c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.173343 Sep 01 16:43:14.213836 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 532/1063] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:14 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:14.518194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:14.520651 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:14.525289 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:14.525772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:14.526201 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:14.526883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:14.527929 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:14.528373 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:14.670669 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:14.681425 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-73e10444-f93e-441d-ac90-497924639737 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1366 microversion: 2.1 time: 0.166753 Sep 01 16:43:14.682385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 532/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:14 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:15.237429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:15.238368 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:15.260863 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:15.262320 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:15.263391 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:15.264644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:15.265458 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:15.266229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:15.503798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:15.512960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:15.514508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:15.518176 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4cc48d2f-be63-4f6a-a11c-18c568c41e4a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1744 microversion: 2.20 time: 0.283364 Sep 01 16:43:15.518176 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 533/1065] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:15 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1744 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:15.703224 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:15.703832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:15.706404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:15.712624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:15.713181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:15.713687 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:15.714619 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:15.715363 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:15.715860 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:15.858458 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:15.866126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c0ab7fc4-4340-42e4-91ba-06307c89aadf tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1366 microversion: 2.1 time: 0.167600 Sep 01 16:43:15.866777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 533/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:15 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:16.545279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:16.547299 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:16.557655 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:16.559048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:16.560107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:16.561334 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:16.562203 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:16.563124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:16.716354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:16.720233 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:16.721818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:16.723010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5bd1d22e-870c-4ae7-8d32-c1b6a359a18b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1744 microversion: 2.20 time: 0.185833 Sep 01 16:43:16.723610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 534/1067] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:16 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:16.893125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:16.894794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:16.904712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:16.905443 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:16.906198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:16.908123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:16.908949 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:16.909974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:17.182847 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:17.196598 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8179dadb-0792-4ef1-b2e7-59c2bce2c14b tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1366 microversion: 2.1 time: 0.307934 Sep 01 16:43:17.197725 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 534/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:16 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:17.747070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:17.747874 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:17.750130 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:17.755962 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:17.756743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:17.757277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:17.758087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:17.758794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:17.759348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:17.903868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:17.919171 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:17.921943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:17.923919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4f076d4f-cd04-4ea2-a114-5be9eeba02a6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1744 microversion: 2.20 time: 0.181541 Sep 01 16:43:17.924848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 535/1069] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:17 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:18.166658 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-c306d445-b784-4d2c-989c-48f17329e94e req-9b8072ce-05f2-4361-9c2c-6fd2c97a8a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aca35b2-1f66-49bb-b9c2-7653ef1e83fd", "name": "network-vif-plugged", "status": "completed", "tag": "1f8ad264-6f25-4cb8-8762-f0b82941a4c4"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:18.172670 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:18.173332 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=10 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:18.178821 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-c306d445-b784-4d2c-989c-48f17329e94e req-9b8072ce-05f2-4361-9c2c-6fd2c97a8a32 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:18.179394 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-c306d445-b784-4d2c-989c-48f17329e94e req-9b8072ce-05f2-4361-9c2c-6fd2c97a8a32 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:18.179815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-c306d445-b784-4d2c-989c-48f17329e94e req-9b8072ce-05f2-4361-9c2c-6fd2c97a8a32 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:18.192010 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-c306d445-b784-4d2c-989c-48f17329e94e req-9b8072ce-05f2-4361-9c2c-6fd2c97a8a32 service nova] Creating event network-vif-plugged:1f8ad264-6f25-4cb8-8762-f0b82941a4c4 for instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd on hv-cinder-83602 Sep 01 16:43:18.197002 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-c306d445-b784-4d2c-989c-48f17329e94e req-9b8072ce-05f2-4361-9c2c-6fd2c97a8a32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034037 Sep 01 16:43:18.197643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 535/1070] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:18.218363 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:18.219117 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:18.225354 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:18.225834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:18.226294 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:18.226957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:18.227433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:18.227855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:18.414633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:18.440592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0e9b0d74-21d2-485d-bf3d-bea996c9e577 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1366 microversion: 2.1 time: 0.226003 Sep 01 16:43:18.442475 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 536/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:18 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:18.964612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:18.965245 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:18.972352 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:18.972906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:18.973266 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:18.973958 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:18.974411 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:18.974843 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:19.131639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:19.140622 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:19.142132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:19.143514 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-234effdc-8763-4b1d-b180-fe889c6debaa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1744 microversion: 2.20 time: 0.184259 Sep 01 16:43:19.144100 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 536/1072] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:18 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:19.474060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:19.474691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:19.481831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:19.482315 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:19.482741 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:19.483496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:19.483941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:19.484355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:19.622498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:19.630115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-54166955-2984-4750-b36a-ec02b768b958 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1366 microversion: 2.1 time: 0.160303 Sep 01 16:43:19.630686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 537/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:19 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:20.166682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:20.168497 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:20.174347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:20.175007 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:20.175464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:20.176152 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:20.176601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:20.177012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:20.215662 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-fc8826f1-a67f-48f7-a16f-0e3ca0a557f2 req-fbc91c85-e5af-419d-8fe3-494547e1188f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3", "name": "network-vif-plugged", "status": "completed", "tag": "611fe9aa-a99e-4482-9ba2-a177311f9a82"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:20.232268 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-fc8826f1-a67f-48f7-a16f-0e3ca0a557f2 req-fbc91c85-e5af-419d-8fe3-494547e1188f service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:20.232996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-fc8826f1-a67f-48f7-a16f-0e3ca0a557f2 req-fbc91c85-e5af-419d-8fe3-494547e1188f service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:20.233419 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-fc8826f1-a67f-48f7-a16f-0e3ca0a557f2 req-fbc91c85-e5af-419d-8fe3-494547e1188f service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:20.268262 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-fc8826f1-a67f-48f7-a16f-0e3ca0a557f2 req-fbc91c85-e5af-419d-8fe3-494547e1188f service nova] Creating event network-vif-plugged:611fe9aa-a99e-4482-9ba2-a177311f9a82 for instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 on hv-cinder-83602 Sep 01 16:43:20.268262 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-fc8826f1-a67f-48f7-a16f-0e3ca0a557f2 req-fbc91c85-e5af-419d-8fe3-494547e1188f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046141 Sep 01 16:43:20.268262 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 538/1074] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:43:20.313262 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:20.321801 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:20.323452 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:20.331507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7931f2a1-ef50-47ad-82ea-48e155a4ff3a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1744 microversion: 2.20 time: 0.162112 Sep 01 16:43:20.331507 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 537/1075] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:20 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:20.652919 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:20.653699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:20.662129 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:20.662998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:20.663842 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:20.665117 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:20.665947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:20.666461 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:20.816436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:20.824998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-166b5a16-c501-4770-80b1-215caea220e9 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1366 microversion: 2.1 time: 0.176943 Sep 01 16:43:20.825773 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 539/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:20 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:21.348367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:21.349020 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:21.356522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:21.357008 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:21.357438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:21.358126 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:21.358577 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:21.358990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:21.508850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:21.522141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:21.524670 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:21.527025 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d437d85a-6edd-4c3f-a35e-69e17bba85b0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1744 microversion: 2.20 time: 0.182332 Sep 01 16:43:21.538723 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 538/1077] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:21 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:21.846635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:21.847518 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:21.855286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:21.855834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:21.861276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:21.861276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:21.861276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:21.861276 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:22.006943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:22.015694 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-696329da-7a40-424b-916a-814e1f9f6303 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1556 microversion: 2.1 time: 0.173021 Sep 01 16:43:22.016268 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 540/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:21 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:22.036503 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-baf9dac8-323a-45f2-b978-18f513bfec9a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:22.037000 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-baf9dac8-323a-45f2-b978-18f513bfec9a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:22.044284 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-baf9dac8-323a-45f2-b978-18f513bfec9a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:22.053675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-baf9dac8-323a-45f2-b978-18f513bfec9a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:22.053675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-baf9dac8-323a-45f2-b978-18f513bfec9a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:22.053675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-baf9dac8-323a-45f2-b978-18f513bfec9a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:22.053675 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-baf9dac8-323a-45f2-b978-18f513bfec9a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:22.054268 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-baf9dac8-323a-45f2-b978-18f513bfec9a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:22.134527 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-baf9dac8-323a-45f2-b978-18f513bfec9a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101852 Sep 01 16:43:22.135767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 539/1079] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 16:43:22 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:22.562288 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:22.562891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:22.569061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:22.569537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:22.569963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:22.570669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:22.571236 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:22.571664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:22.790960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:22.802262 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:22.804175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:22.805623 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cbbe3803-b3b4-40bc-8264-ef226f1170c7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1744 microversion: 2.20 time: 0.247904 Sep 01 16:43:22.816659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 541/1080] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:22 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:23.389259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-7c4ab80e-3333-4bd6-b7f6-a254d66953a5 req-04496aa8-41e1-458b-ad94-e91589f6162c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aca35b2-1f66-49bb-b9c2-7653ef1e83fd", "tag": "1f8ad264-6f25-4cb8-8762-f0b82941a4c4"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:23.401854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7c4ab80e-3333-4bd6-b7f6-a254d66953a5 req-04496aa8-41e1-458b-ad94-e91589f6162c service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:23.402761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7c4ab80e-3333-4bd6-b7f6-a254d66953a5 req-04496aa8-41e1-458b-ad94-e91589f6162c service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:23.403563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7c4ab80e-3333-4bd6-b7f6-a254d66953a5 req-04496aa8-41e1-458b-ad94-e91589f6162c service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:23.426566 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-7c4ab80e-3333-4bd6-b7f6-a254d66953a5 req-04496aa8-41e1-458b-ad94-e91589f6162c service nova] Creating event network-changed:1f8ad264-6f25-4cb8-8762-f0b82941a4c4 for instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd on hv-cinder-83602 Sep 01 16:43:23.437164 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-7c4ab80e-3333-4bd6-b7f6-a254d66953a5 req-04496aa8-41e1-458b-ad94-e91589f6162c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053021 Sep 01 16:43:23.438236 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 540/1081] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:43:23.844847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:23.846195 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:23.853215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:23.854343 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:23.855011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:23.855870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:23.856548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:23.857179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:24.230468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:24.242887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:24.246176 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:24.250957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-10619bec-7b37-4a7b-bf2e-a64e19b5fae0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.417161 Sep 01 16:43:24.252339 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 542/1082] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:23 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:25.295441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:25.296203 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:25.303031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:25.303681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:25.304107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:25.304805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:25.305252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:25.305657 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:25.560472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:25.572784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:25.575116 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:25.576853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5cf324ba-e2d1-4f71-a660-91e34ae117e1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.287882 Sep 01 16:43:25.577431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 541/1083] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:25 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:26.606069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:26.607486 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:26.614850 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:26.616270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:26.616891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:26.617508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:26.618474 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:26.620018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:26.620981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:26.789897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:26.798982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:26.800441 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:26.801598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-619b97c5-8b6f-44e4-ba8d-a1c9876f2943 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.200205 Sep 01 16:43:26.802152 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 543/1084] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:26 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:27.826262 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:27.826874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:27.833980 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:27.834491 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:27.834924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:27.835649 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:27.836101 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:27.836530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:28.042762 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:28.053235 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:28.054773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:28.056594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e1863c11-2d20-434b-aee8-37596d2ce37a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.233687 Sep 01 16:43:28.057344 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 542/1085] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:27 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:29.091981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:29.092707 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:29.099257 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:29.099737 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:29.100164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:29.100898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:29.101658 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:29.102100 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:29.252894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:29.262899 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:29.264385 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:29.265542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c8ae302a-2ce4-4ae9-8497-4a802194ef5b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.178804 Sep 01 16:43:29.266224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 544/1086] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:29 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:30.289702 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:30.291613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:30.300422 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:30.301206 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:30.301714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:30.302784 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:30.303626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:30.304142 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:30.502621 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:30.507363 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:30.514323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:30.517768 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:30.517768 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-626ae565-1887-4965-8bd1-96410c9263cb tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.231696 Sep 01 16:43:30.517768 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 543/1087] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:30 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:31.540824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:31.541581 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:31.548486 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:31.549394 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:31.550066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:31.550787 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:31.551269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:31.551698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:31.712525 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:31.732004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:31.734875 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:31.736821 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-93e84021-88c2-4005-b5aa-e2a8e27e9fe9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.199895 Sep 01 16:43:31.737643 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 545/1088] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:31 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:32.762843 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:32.763491 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:32.770094 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:32.770581 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:32.771025 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:32.771751 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:32.772233 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:32.772657 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:32.935276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:32.944467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:32.946888 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:32.948558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3062727c-308b-4d44-9344-577beb17f282 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.190803 Sep 01 16:43:32.949480 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 544/1089] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:32 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:33.974477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:33.975083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:33.983547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:33.984679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:33.985155 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:33.985945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:33.986676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:33.987110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:34.149256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:34.160769 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:34.163313 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:34.165254 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-05e1248d-01ba-4d06-86fa-d3b43f60cece tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.194548 Sep 01 16:43:34.166532 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 546/1090] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:33 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:35.189969 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:35.191441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:35.200447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:35.201307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:35.202138 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:35.204261 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:35.204261 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:35.210617 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:35.409776 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:35.423804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:35.426932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:35.429594 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e4b7d7e-14b5-4750-87c3-fb51db8a7d68 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.243660 Sep 01 16:43:35.431049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 545/1091] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:35 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:36.457807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:36.458778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:36.466414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:36.467277 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:36.467939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:36.468931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:36.469611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:36.470198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:36.494123 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:36.624338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:36.633656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:36.635135 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:36.636341 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-08254303-f3a8-4d6e-aacc-d502135daf14 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.185477 Sep 01 16:43:36.636901 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 547/1092] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:36 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:37.660281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:37.661165 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:37.668795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:37.669714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:37.670330 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:37.671267 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:37.679003 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:37.679003 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:37.849135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:37.862110 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:37.863616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:37.864834 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-94095ea6-1209-40ef-83cf-c2f0b0f535f9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.208845 Sep 01 16:43:37.866001 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 546/1093] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:37 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:38.891487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:38.892056 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:38.898915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:38.899723 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:38.900154 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:38.900851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:38.901298 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:38.901869 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:39.090546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:39.104610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:39.107389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:39.109389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0b54002e-b09d-4861-a1ca-64d6d8f6d871 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.223181 Sep 01 16:43:39.110432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 548/1094] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:38 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:40.134245 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:40.134876 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:40.141265 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.141748 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.142174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.143028 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.143499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.143943 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.279497 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:40.287667 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:40.289307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:40.290471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-28996a67-e107-48ce-ad12-e96d431a268e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.161030 Sep 01 16:43:40.291027 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 547/1095] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:40 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:41.313959 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:41.314613 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:41.323406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:41.324043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:41.324630 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:41.325383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:41.325876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:41.326554 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:41.476371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:41.484606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:41.486083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:41.487290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-157badfe-02f4-47f8-afc3-ca0acd5bac99 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1739 microversion: 2.20 time: 0.177314 Sep 01 16:43:41.487843 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 549/1096] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:41 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:42.510826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:42.511479 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:42.518029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:42.518502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:42.518929 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:42.519637 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:42.520081 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:42.520501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:42.658878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:42.668296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:42.669758 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:42.670947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-32f8171d-b83e-43fa-bf3d-90d2a9f8885a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1721 microversion: 2.20 time: 0.165006 Sep 01 16:43:42.671543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 548/1097] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:42 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:43.695974 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:43.696583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:43.703578 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.704065 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.704497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.705190 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.705785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.706044 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.817890 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-048563e0-3a7c-445a-993f-8afc4ca9ab0b req-a24bdd18-ff4e-4607-acb2-3c36d404d533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3", "name": "network-vif-unplugged", "status": "completed", "tag": "611fe9aa-a99e-4482-9ba2-a177311f9a82"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:43.828948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-048563e0-3a7c-445a-993f-8afc4ca9ab0b req-a24bdd18-ff4e-4607-acb2-3c36d404d533 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.829430 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-048563e0-3a7c-445a-993f-8afc4ca9ab0b req-a24bdd18-ff4e-4607-acb2-3c36d404d533 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.829857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-048563e0-3a7c-445a-993f-8afc4ca9ab0b req-a24bdd18-ff4e-4607-acb2-3c36d404d533 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.844136 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-048563e0-3a7c-445a-993f-8afc4ca9ab0b req-a24bdd18-ff4e-4607-acb2-3c36d404d533 service nova] Creating event network-vif-unplugged:611fe9aa-a99e-4482-9ba2-a177311f9a82 for instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 on hv-cinder-83602 Sep 01 16:43:43.844679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:43.849408 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-048563e0-3a7c-445a-993f-8afc4ca9ab0b req-a24bdd18-ff4e-4607-acb2-3c36d404d533 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035186 Sep 01 16:43:43.851260 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 549/1098] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:43:43.860128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:43.862909 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:43.864979 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-516aab84-a896-43eb-b051-43c5bacfffc1 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1721 microversion: 2.20 time: 0.173537 Sep 01 16:43:43.866360 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 550/1099] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:43 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:44.890989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:44.891803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:44.898141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.898637 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.899086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:44.899883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.900270 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.900702 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:45.039697 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:45.047937 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:45.049345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:45.050502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ed5d097c-7c42-4535-b27b-bb5f2ea7d217 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1724 microversion: 2.20 time: 0.164477 Sep 01 16:43:45.051060 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 550/1100] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:44 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:45.074970 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-58609ab8-ba97-438e-9167-d187237ffde7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62bcd651-7091-4111-a82c-0dd59e88b27a"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:45.077322 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-58609ab8-ba97-438e-9167-d187237ffde7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:45.084187 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58609ab8-ba97-438e-9167-d187237ffde7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:45.084914 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58609ab8-ba97-438e-9167-d187237ffde7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:45.085359 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58609ab8-ba97-438e-9167-d187237ffde7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:45.086058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58609ab8-ba97-438e-9167-d187237ffde7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:45.086497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58609ab8-ba97-438e-9167-d187237ffde7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:45.086924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-58609ab8-ba97-438e-9167-d187237ffde7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:46.244699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-58609ab8-ba97-438e-9167-d187237ffde7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.173473 Sep 01 16:43:46.245718 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 551/1101] 10.222.0.16 () {62 vars in 1364 bytes} [Thu Sep 1 16:43:45 2022] POST /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/os-volume_attachments => generated 188 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:43:46.371264 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7fb1fe9c-0ef2-4d10-8fdf-a541441fa122 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:46.371817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7fb1fe9c-0ef2-4d10-8fdf-a541441fa122 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:46.374245 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=36 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:46.378905 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb1fe9c-0ef2-4d10-8fdf-a541441fa122 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:46.379454 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb1fe9c-0ef2-4d10-8fdf-a541441fa122 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:46.379880 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb1fe9c-0ef2-4d10-8fdf-a541441fa122 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:46.380596 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb1fe9c-0ef2-4d10-8fdf-a541441fa122 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:46.381067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb1fe9c-0ef2-4d10-8fdf-a541441fa122 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:46.381485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb1fe9c-0ef2-4d10-8fdf-a541441fa122 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:47.374879 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7fb1fe9c-0ef2-4d10-8fdf-a541441fa122 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/os-volume_attachments/62bcd651-7091-4111-a82c-0dd59e88b27a" status: 202 len: 0 microversion: 2.20 time: 1.007606 Sep 01 16:43:47.375667 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 551/1102] 10.222.0.16 () {60 vars in 1457 bytes} [Thu Sep 1 16:43:46 2022] DELETE /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/os-volume_attachments/62bcd651-7091-4111-a82c-0dd59e88b27a => generated 0 bytes in 1009 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:43:47.438243 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:47.443718 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:47.446308 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:47.446789 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:47.447245 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:47.447937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:47.448390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:47.448808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:47.497318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127532) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:43:47.840635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-82d9e5ad-8f06-48bd-bfe8-b382d4b046e4 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/action" status: 202 len: 0 microversion: 2.20 time: 0.406352 Sep 01 16:43:47.841509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 552/1103] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 1 16:43:47 2022] POST /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:43:47.850647 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:47.851382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:47.858199 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:47.864979 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:47.864979 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:47.864979 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:47.864979 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:47.866678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:48.015293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:48.024804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:48.026274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:48.027492 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-59fc8bb7-8fe6-4c25-8284-872dbc4b038e tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1672 microversion: 2.20 time: 0.181410 Sep 01 16:43:48.028377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 552/1104] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:47 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:49.052036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:49.053401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:49.059493 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:49.059982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:49.060415 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:49.061148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:49.061604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:49.062028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:49.434650 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:49.443028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:49.444725 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:49.445871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-88dc1e96-7e89-4207-b7ec-2f01158f8c39 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1672 microversion: 2.20 time: 0.398632 Sep 01 16:43:49.446429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 553/1105] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:49 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1672 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:50.470885 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:50.471683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:50.478741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:50.479306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:50.479741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:50.480424 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:50.480874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:50.481290 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:50.617948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:50.626147 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:50.627609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:50.628766 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-957f6523-6cdd-40df-b69a-980641618501 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.161833 Sep 01 16:43:50.629392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 553/1106] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:50 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:50.820471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6b4c4837-d7e9-4e3d-a91d-52616ff488c1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:50.820945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6b4c4837-d7e9-4e3d-a91d-52616ff488c1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:50.827166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b4c4837-d7e9-4e3d-a91d-52616ff488c1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:50.827922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b4c4837-d7e9-4e3d-a91d-52616ff488c1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:50.828348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b4c4837-d7e9-4e3d-a91d-52616ff488c1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:50.829027 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b4c4837-d7e9-4e3d-a91d-52616ff488c1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:50.829468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b4c4837-d7e9-4e3d-a91d-52616ff488c1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:50.829886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6b4c4837-d7e9-4e3d-a91d-52616ff488c1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:50.853138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6b4c4837-d7e9-4e3d-a91d-52616ff488c1 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/ips" status: 200 len: 147 microversion: 2.1 time: 0.183664 Sep 01 16:43:50.853704 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 554/1107] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:43:50 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/ips => generated 147 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:51.652460 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:51.653090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:51.659806 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:51.663773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:51.663773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:51.663773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:51.663773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:51.664178 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:51.808187 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:51.816877 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:51.819080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:51.820269 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7af8f1df-d81b-4024-9989-9563ecff0ef7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.171937 Sep 01 16:43:51.820831 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 554/1108] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:51 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:52.844303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:52.844944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:52.852115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:52.852592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:52.853029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:52.853716 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:52.854162 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:52.854760 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:52.987356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:52.998159 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:52.999691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:53.000841 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-656afdfc-4bb6-43bb-abc6-4c2685268d20 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.160623 Sep 01 16:43:53.001397 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 555/1109] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:52 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:54.024356 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:54.024962 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:54.031929 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:54.032412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:54.032854 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:54.033579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:54.034033 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:54.034456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:54.212578 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:54.223590 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:54.225496 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:54.226692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a0107e88-c317-4204-a019-12640c61e7ce tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.206776 Sep 01 16:43:54.227291 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 555/1110] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:54 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:55.251475 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:55.252729 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:55.260776 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:55.261362 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:55.261806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:55.262511 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:55.262961 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:55.263410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:55.407521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:55.424535 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:55.426527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:55.427741 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2914c6f4-38f0-4cd3-9d6c-57614cd337fc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.180236 Sep 01 16:43:55.428317 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 556/1111] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:55 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:56.452119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:56.452817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:56.459070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:56.459604 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:56.460034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:56.460739 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:56.461193 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:56.461616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:56.599664 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:56.607775 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:56.609216 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:56.610368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-87a2745f-7959-4e61-860f-3836b3fd06dc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.163194 Sep 01 16:43:56.610930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 556/1112] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:56 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:57.640759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:57.642641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:57.650064 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:57.655982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:57.656713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:57.657169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:57.657923 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:57.658414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:57.658870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:57.815105 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:57.824298 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:57.825727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:57.827172 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-830ec586-44b5-4c29-8c04-053f10eff8b9 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.193253 Sep 01 16:43:57.827736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 557/1113] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:57 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:57.861802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-98694fa4-7d29-48c4-8086-2da08c1c9c0a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7970b7df-40e3-4fad-aa91-c99101144782"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:57.864315 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-98694fa4-7d29-48c4-8086-2da08c1c9c0a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:57.870975 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98694fa4-7d29-48c4-8086-2da08c1c9c0a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:57.871500 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98694fa4-7d29-48c4-8086-2da08c1c9c0a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:57.871946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98694fa4-7d29-48c4-8086-2da08c1c9c0a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:57.872644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98694fa4-7d29-48c4-8086-2da08c1c9c0a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:57.873103 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98694fa4-7d29-48c4-8086-2da08c1c9c0a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:57.873529 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98694fa4-7d29-48c4-8086-2da08c1c9c0a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:58.853348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:58.853955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:58.860460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:58.860938 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:58.861370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:58.862060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:58.862508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:58.863600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:58.999571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:59.009200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:59.014659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:59.014659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-94698f5f-d711-48b6-8441-18b7d3b7fd29 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.162903 Sep 01 16:43:59.014659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 558/1114] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:58 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:44:00.039167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:00.039820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:00.047731 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:00.048586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:00.049312 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:00.050236 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:00.050758 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:00.052347 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:00.195056 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:00.204206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:00.205900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:00.207621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-41fd5c1f-ddf3-4589-bc17-562f06e6d426 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.172149 Sep 01 16:44:00.209537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 559/1115] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:00 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:01.229928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:01.231546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:01.239260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:01.240118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:01.240785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:01.241870 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:01.242557 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:01.243221 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:01.399988 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:01.403643 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:01.409080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:01.411455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:01.413334 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3afd5393-a8b6-4d66-b23b-a92707d0045b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.187089 Sep 01 16:44:01.421806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 560/1116] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:01 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:02.437913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:02.438609 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:02.445827 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:02.446298 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:02.446723 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:02.447423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:02.447867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:02.448281 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:02.592580 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:02.602689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:02.604170 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:02.605854 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-05eb3468-5bc6-45de-98e4-f707dfe1cba8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.171749 Sep 01 16:44:02.608533 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 561/1117] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:02 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:03.660056 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:03.660988 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:03.667124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:03.667630 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:03.668059 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:03.668744 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:03.669195 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:03.669617 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:03.818997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:03.827401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:03.828847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:03.830002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c1e671da-e649-42ba-a44d-751b38fd3cb6 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.174169 Sep 01 16:44:03.830560 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 562/1118] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:03 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:04.853476 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:04.854122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:04.860325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:04.860798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:04.861223 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:04.861904 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:04.862348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:04.863460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:05.009402 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:05.020644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:05.022089 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:05.023287 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1d370e2b-c098-443b-a456-b4e5188282aa tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.173685 Sep 01 16:44:05.023850 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 563/1119] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:04 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:44:06.048430 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:06.049060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:06.056223 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:06.056705 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:06.057137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:06.057903 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:06.058374 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:06.058773 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:06.200138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:06.209057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:06.210512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:06.211726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8304de5a-0a0f-4048-95c4-b30fe16576c3 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.167426 Sep 01 16:44:06.212291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 564/1120] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:06 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:44:07.235260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:07.235956 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:07.242549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:07.243021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:07.243478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:07.244160 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:07.244601 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:07.245019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:07.374187 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:07.382234 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:07.383701 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:07.384852 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dcc40e6f-49d5-4b05-bd9f-3b47ec23ab97 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.153580 Sep 01 16:44:07.385413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 565/1121] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:07 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:07.868996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=13 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:07.951765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:08.407668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:08.408253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:08.414975 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:08.415586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:08.416022 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:08.416722 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:08.417168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:08.417586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:08.550232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:08.558543 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:08.560005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:08.561157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6bd6d9e0-d371-400f-8c2a-9582e9843ccf tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.157472 Sep 01 16:44:08.561713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 566/1122] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:08 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:09.585637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:09.586358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:09.593007 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:09.593490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:09.593923 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:09.594619 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:09.595071 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:09.595521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:09.734673 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:09.744359 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:09.746637 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:09.748395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f2081956-3876-40dc-962d-1e98598c9a5c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.167189 Sep 01 16:44:09.749083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 567/1123] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:09 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:10.773346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:10.774794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:10.781365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:10.781859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:10.782295 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:10.783002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:10.783480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:10.783900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:10.913010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:10.921000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:10.922423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:10.923597 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d9eeb07c-c16b-4ba4-bcc4-3ea9f67c5879 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.154176 Sep 01 16:44:10.924150 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 568/1124] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:10 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:11.948693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:11.949411 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:11.956592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:11.957289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:11.957723 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:11.958408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:11.958886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:11.959337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:12.112936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:12.126960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:12.130114 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:12.131938 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7a9361ff-3d55-4ae8-a637-c418694cf69a tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.186983 Sep 01 16:44:12.132982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 569/1125] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:11 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:13.167972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:13.168661 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:13.176239 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.176633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.177067 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.177767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.178219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.178643 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.336586 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:13.344599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:13.346032 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:13.348174 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c1b9e128-272a-472e-9db6-ed2c13ee1690 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.184165 Sep 01 16:44:13.349286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 570/1126] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:13 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:44:14.370438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:14.371133 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:14.377600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:14.378081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:14.378505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:14.379215 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:14.379662 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:14.380490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:14.515028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:14.524766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:14.526737 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:14.527966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dc9943a4-80d9-4b3d-a75a-bfaa4097827c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.161479 Sep 01 16:44:14.534968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 571/1127] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:14 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:15.231593 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-98694fa4-7d29-48c4-8086-2da08c1c9c0a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 17.373774 Sep 01 16:44:15.232380 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 557/1128] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:43:57 2022] POST /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments => generated 194 bytes in 17375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:15.555721 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:15.556439 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:15.562811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:15.563505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:15.563868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:15.564790 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:15.565541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:15.566182 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:15.710108 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:15.720239 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:15.721849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:15.723031 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d02d3269-fa38-4feb-b2be-bcd0aabd24ed tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.175384 Sep 01 16:44:15.723604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 572/1129] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:15 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:44:16.747733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:16.748425 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:16.755826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:16.756355 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:16.756742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:16.757430 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:16.757875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:16.758288 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:16.893164 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:16.901468 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:16.903377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:16.904308 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9e10783b-9be4-4a7d-9b94-90afe9c7611c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.161460 Sep 01 16:44:16.918210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 558/1130] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:16 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:44:17.930008 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:17.930535 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:17.936450 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:17.936930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:17.937359 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:17.938056 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:17.938507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:17.938933 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:18.086624 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:18.095016 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:18.096469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:18.097660 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-52c477c4-ad17-48f6-8d0e-b791a2a38d5f tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.172777 Sep 01 16:44:18.098222 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 573/1131] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:17 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:44:18.196428 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-f47ad5ed-f3b5-4f96-a9fc-f831f76f4800 req-14a7adab-6cb7-470f-afc6-b5f1201ad55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3", "name": "network-vif-plugged", "status": "completed", "tag": "611fe9aa-a99e-4482-9ba2-a177311f9a82"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:18.207803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-f47ad5ed-f3b5-4f96-a9fc-f831f76f4800 req-14a7adab-6cb7-470f-afc6-b5f1201ad55b service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:18.208583 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-f47ad5ed-f3b5-4f96-a9fc-f831f76f4800 req-14a7adab-6cb7-470f-afc6-b5f1201ad55b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:18.209307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-f47ad5ed-f3b5-4f96-a9fc-f831f76f4800 req-14a7adab-6cb7-470f-afc6-b5f1201ad55b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:18.225329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-f47ad5ed-f3b5-4f96-a9fc-f831f76f4800 req-14a7adab-6cb7-470f-afc6-b5f1201ad55b service nova] Creating event network-vif-plugged:611fe9aa-a99e-4482-9ba2-a177311f9a82 for instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 on hv-cinder-83602 Sep 01 16:44:18.230532 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-f47ad5ed-f3b5-4f96-a9fc-f831f76f4800 req-14a7adab-6cb7-470f-afc6-b5f1201ad55b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104496 Sep 01 16:44:18.231239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 559/1132] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:19.120968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:19.121716 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:19.128592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:19.129364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:19.129859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:19.130668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:19.131189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:19.131700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:19.344626 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:19.351978 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:19.353448 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:19.354572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-158c2c4d-cf9d-4cb3-9ba7-4798f29f9bf7 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.237476 Sep 01 16:44:19.355189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 574/1133] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:19 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:44:20.381826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:20.382519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:20.389323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:20.389914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:20.390252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:20.391551 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:20.391551 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:20.391915 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:20.547393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:20.562275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:20.564149 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:20.566581 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ec81454e-7608-47f7-b560-d2e84c49ef1c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.189088 Sep 01 16:44:20.567550 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 560/1134] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:20 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:21.591845 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:21.592440 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:21.600461 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:21.601004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:21.601466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:21.602206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:21.602664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:21.603110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:21.742812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:21.751615 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:21.753130 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:21.754957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a38b9911-9c3b-4ca2-9c66-ab94a49f64d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1730 microversion: 2.20 time: 0.166954 Sep 01 16:44:21.755770 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 575/1135] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:21 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:44:22.779301 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:22.779964 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:22.787187 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:22.787683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:22.788119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:22.788817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:22.789327 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:22.789750 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:22.920656 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:22.929185 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:22.930638 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:22.931832 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4469b4e7-b773-4010-b71e-a7556e4be178 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1717 microversion: 2.20 time: 0.156545 Sep 01 16:44:22.932404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 561/1136] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:44:22 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:44:23.871696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e9f9721d-1825-4fa2-879e-f408f83b5b81 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:23.874526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e9f9721d-1825-4fa2-879e-f408f83b5b81 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:23.884196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e9f9721d-1825-4fa2-879e-f408f83b5b81 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:23.884824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e9f9721d-1825-4fa2-879e-f408f83b5b81 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:23.885252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e9f9721d-1825-4fa2-879e-f408f83b5b81 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:23.885936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e9f9721d-1825-4fa2-879e-f408f83b5b81 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:23.886380 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e9f9721d-1825-4fa2-879e-f408f83b5b81 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:23.886794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e9f9721d-1825-4fa2-879e-f408f83b5b81 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:23.916555 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e9f9721d-1825-4fa2-879e-f408f83b5b81 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050109 Sep 01 16:44:23.917148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 576/1137] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:44:23 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:23.928757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c4c7949d-7844-428f-8101-a5e6d14ebb62 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:23.929264 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c4c7949d-7844-428f-8101-a5e6d14ebb62 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:23.935812 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4c7949d-7844-428f-8101-a5e6d14ebb62 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:23.936295 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4c7949d-7844-428f-8101-a5e6d14ebb62 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:23.936729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4c7949d-7844-428f-8101-a5e6d14ebb62 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:23.937423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4c7949d-7844-428f-8101-a5e6d14ebb62 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:23.937880 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4c7949d-7844-428f-8101-a5e6d14ebb62 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:23.938305 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4c7949d-7844-428f-8101-a5e6d14ebb62 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:23.970328 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c4c7949d-7844-428f-8101-a5e6d14ebb62 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/7970b7df-40e3-4fad-aa91-c99101144782" status: 200 len: 194 microversion: 2.1 time: 0.046293 Sep 01 16:44:23.970872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 562/1138] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Sep 1 16:44:23 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/7970b7df-40e3-4fad-aa91-c99101144782 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:29.789087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4a8887be-3a2e-4a5d-8e2f-5a7f1ce44929 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9f8c51e-9ad3-416f-b506-d1ca2938b94d"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:29.791541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4a8887be-3a2e-4a5d-8e2f-5a7f1ce44929 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:29.793551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=40 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:29.798127 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a8887be-3a2e-4a5d-8e2f-5a7f1ce44929 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:29.798611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a8887be-3a2e-4a5d-8e2f-5a7f1ce44929 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:29.799096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a8887be-3a2e-4a5d-8e2f-5a7f1ce44929 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:29.800435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a8887be-3a2e-4a5d-8e2f-5a7f1ce44929 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:29.800887 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a8887be-3a2e-4a5d-8e2f-5a7f1ce44929 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:29.801308 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4a8887be-3a2e-4a5d-8e2f-5a7f1ce44929 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:29.818345 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=100 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:34.132090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4a8887be-3a2e-4a5d-8e2f-5a7f1ce44929 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "POST /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.346811 Sep 01 16:44:34.132736 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 577/1139] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:44:29 2022] POST /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments => generated 194 bytes in 4348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:42.859213 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c362dfbf-f035-4bc4-8c37-1dfa8662bc76 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:42.861519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c362dfbf-f035-4bc4-8c37-1dfa8662bc76 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:42.864869 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=10 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:42.865526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:42.870225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c362dfbf-f035-4bc4-8c37-1dfa8662bc76 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:42.870712 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c362dfbf-f035-4bc4-8c37-1dfa8662bc76 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:42.871143 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c362dfbf-f035-4bc4-8c37-1dfa8662bc76 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:42.879316 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c362dfbf-f035-4bc4-8c37-1dfa8662bc76 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:42.879316 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c362dfbf-f035-4bc4-8c37-1dfa8662bc76 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:42.879316 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c362dfbf-f035-4bc4-8c37-1dfa8662bc76 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:42.905765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c362dfbf-f035-4bc4-8c37-1dfa8662bc76 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050284 Sep 01 16:44:42.906701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 563/1140] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:44:42 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:43.065106 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:43.071279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b0840d87-d252-40f1-97a9-cd47e8b4e711 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:43.072082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b0840d87-d252-40f1-97a9-cd47e8b4e711 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:43.079076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b0840d87-d252-40f1-97a9-cd47e8b4e711 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:43.086050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b0840d87-d252-40f1-97a9-cd47e8b4e711 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:43.086050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b0840d87-d252-40f1-97a9-cd47e8b4e711 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:43.086050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b0840d87-d252-40f1-97a9-cd47e8b4e711 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:43.086050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b0840d87-d252-40f1-97a9-cd47e8b4e711 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:43.086485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b0840d87-d252-40f1-97a9-cd47e8b4e711 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:43.117278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b0840d87-d252-40f1-97a9-cd47e8b4e711 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/7970b7df-40e3-4fad-aa91-c99101144782" status: 200 len: 194 microversion: 2.1 time: 0.053510 Sep 01 16:44:43.117873 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 578/1141] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Sep 1 16:44:43 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/7970b7df-40e3-4fad-aa91-c99101144782 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:43.129544 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:43.130125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:43.137107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:43.137601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:43.138046 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:43.138752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:43.139249 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:43.154746 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:43.227772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lazy-loading 'services' on Instance uuid 70e4fec9-b6c8-4535-a00d-1df0a58e9019 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:44:43.429247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-29ca8a89-dc26-4cc8-bc75-8d71860ca898 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/7970b7df-40e3-4fad-aa91-c99101144782" status: 202 len: 0 microversion: 2.1 time: 0.304315 Sep 01 16:44:43.429758 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 564/1142] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:44:43 2022] DELETE /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/7970b7df-40e3-4fad-aa91-c99101144782 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:44:45.628371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0e463928-cac6-448a-afc8-06d5ba552bd4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:45.629013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0e463928-cac6-448a-afc8-06d5ba552bd4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:45.635433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e463928-cac6-448a-afc8-06d5ba552bd4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.635912 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e463928-cac6-448a-afc8-06d5ba552bd4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.636342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e463928-cac6-448a-afc8-06d5ba552bd4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.637026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e463928-cac6-448a-afc8-06d5ba552bd4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.637471 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e463928-cac6-448a-afc8-06d5ba552bd4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.637886 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0e463928-cac6-448a-afc8-06d5ba552bd4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.671058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0e463928-cac6-448a-afc8-06d5ba552bd4 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/f9f8c51e-9ad3-416f-b506-d1ca2938b94d" status: 200 len: 194 microversion: 2.1 time: 0.047011 Sep 01 16:44:45.671713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 579/1143] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Sep 1 16:44:45 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/f9f8c51e-9ad3-416f-b506-d1ca2938b94d => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:45.683756 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:45.684404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:45.690426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.691563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.692038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.692721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:45.693168 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:45.693585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:45.775022 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lazy-loading 'services' on Instance uuid 70e4fec9-b6c8-4535-a00d-1df0a58e9019 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:44:45.961160 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-336a23a2-158a-4c93-bd68-afb190430cfa tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/f9f8c51e-9ad3-416f-b506-d1ca2938b94d" status: 202 len: 0 microversion: 2.1 time: 0.282099 Sep 01 16:44:45.961762 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 565/1144] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:44:45 2022] DELETE /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments/f9f8c51e-9ad3-416f-b506-d1ca2938b94d => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:44:48.213840 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a8c21ce7-7f1a-4343-8e8b-53e30fcaf525 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:48.216059 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a8c21ce7-7f1a-4343-8e8b-53e30fcaf525 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:48.222554 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a8c21ce7-7f1a-4343-8e8b-53e30fcaf525 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.222941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a8c21ce7-7f1a-4343-8e8b-53e30fcaf525 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.223698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a8c21ce7-7f1a-4343-8e8b-53e30fcaf525 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.224496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a8c21ce7-7f1a-4343-8e8b-53e30fcaf525 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.224822 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a8c21ce7-7f1a-4343-8e8b-53e30fcaf525 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.225291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a8c21ce7-7f1a-4343-8e8b-53e30fcaf525 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.256256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a8c21ce7-7f1a-4343-8e8b-53e30fcaf525 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046369 Sep 01 16:44:48.256841 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 580/1145] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:44:48 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:44:48.373467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be3dbff8-9bd0-4424-8e47-5ee18a5e4dc9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:48.375915 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be3dbff8-9bd0-4424-8e47-5ee18a5e4dc9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:48.383522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be3dbff8-9bd0-4424-8e47-5ee18a5e4dc9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.385659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be3dbff8-9bd0-4424-8e47-5ee18a5e4dc9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.385659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be3dbff8-9bd0-4424-8e47-5ee18a5e4dc9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.385659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be3dbff8-9bd0-4424-8e47-5ee18a5e4dc9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.385659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be3dbff8-9bd0-4424-8e47-5ee18a5e4dc9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.386227 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be3dbff8-9bd0-4424-8e47-5ee18a5e4dc9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.420992 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be3dbff8-9bd0-4424-8e47-5ee18a5e4dc9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052005 Sep 01 16:44:48.421587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 566/1146] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:44:48 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:44:48.489745 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:48.490246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:48.496547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.497033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.497824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.498237 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.498691 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.499116 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.525126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:44:48.818420 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-132207b1-106e-4ae8-a95b-5306d7f0abf3 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 204 len: 0 microversion: 2.1 time: 0.332574 Sep 01 16:44:48.819011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 581/1147] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:44:48 2022] DELETE /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:44:48.827705 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:48.831906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:48.834604 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.835078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.835585 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.836260 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:48.836706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:48.837122 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:48.987390 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:49.000624 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-86007e51-7aeb-48a5-b760-b7fc0785b58a tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1675 microversion: 2.1 time: 0.176682 Sep 01 16:44:49.001207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 567/1148] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:48 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:50.025148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:50.026487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:50.034632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:50.034632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:50.034632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:50.034924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:50.035333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:50.035832 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:50.233955 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:50.247498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3721af24-ee1a-4dec-9447-68b72fa80b3f tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1675 microversion: 2.1 time: 0.228976 Sep 01 16:44:50.248115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 582/1149] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:50 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:51.277769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:51.278564 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:51.287441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:51.287990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:51.288424 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:51.289796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:51.290478 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:51.291062 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:51.449395 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:51.460241 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b2a83c49-7ef0-4c37-bf03-39a71714b6b2 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1675 microversion: 2.1 time: 0.186686 Sep 01 16:44:51.460952 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 568/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:51 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:52.483749 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:52.484517 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:52.493706 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:52.494998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:52.495647 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:52.497060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:52.497856 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:52.498753 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:52.625487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:52.634321 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0fca4f9b-8f28-4417-b6df-02e93d228218 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1608 microversion: 2.1 time: 0.156186 Sep 01 16:44:52.635574 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 583/1151] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:52 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1608 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:53.229666 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-0678b7d0-b4de-4b0c-a7ce-971829026a37 req-87937f29-207f-44c2-ac94-a977a44d765a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e4fec9-b6c8-4535-a00d-1df0a58e9019", "name": "network-vif-deleted", "tag": "f4bb15e3-c3b8-43c9-a3c3-216dfa593471"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:53.240469 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-0678b7d0-b4de-4b0c-a7ce-971829026a37 req-87937f29-207f-44c2-ac94-a977a44d765a service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:53.241210 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-0678b7d0-b4de-4b0c-a7ce-971829026a37 req-87937f29-207f-44c2-ac94-a977a44d765a service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:53.241653 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-0678b7d0-b4de-4b0c-a7ce-971829026a37 req-87937f29-207f-44c2-ac94-a977a44d765a service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:53.255046 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-0678b7d0-b4de-4b0c-a7ce-971829026a37 req-87937f29-207f-44c2-ac94-a977a44d765a service nova] Creating event network-vif-deleted:f4bb15e3-c3b8-43c9-a3c3-216dfa593471 for instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 on hv-cinder-83602 Sep 01 16:44:53.261306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-0678b7d0-b4de-4b0c-a7ce-971829026a37 req-87937f29-207f-44c2-ac94-a977a44d765a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215514 Sep 01 16:44:53.262321 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 569/1152] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:53.657465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:53.658033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:53.679762 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:53.689929 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:53.693567 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:53.694686 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:53.695436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:53.695856 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:53.761638 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:53.761638 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:53.761638 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:53.762167 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lazy-loading 'fault' on Instance uuid 70e4fec9-b6c8-4535-a00d-1df0a58e9019 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:44:53.837901 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6ff7908e84a5994a51be0cfc82414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c787c684c86144c792d9afc457ac3212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:53.849966 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fb8a5f4a-0818-4c1f-9cb9-bfeedb208464 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 200 len: 1328 microversion: 2.1 time: 0.196527 Sep 01 16:44:53.850905 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 584/1153] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:53 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 1328 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:54.871982 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:54.872686 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:54.880229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:54.880742 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:54.881174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:54.881881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:54.882465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:54.882747 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:54.899134 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] HTTP exception thrown: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Request method failure captured: Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 HTTP/1.1 Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7Hufjvuzg0MlUpGchlhUdKmcwC-6ghPWMG6-QE-KzERxQoU60gi542NDyqs0BYwcCweLi-bkWIZpnoGLqF9aZnucFAfU70l5wQJ4ieLVwgWxnjBjtUHsUGJbFoHRFFhPfOToAnKWsP-TYuTRHZh-o1BxoT5Fx2g5t5n55b0r45Fkc Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:44:54.901097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c787c684c86144c792d9afc457ac3212", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 21e6ff7908e84a5994a51be0cfc82414 Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:54.902798 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '70e4fec9-b6c8-4535-a00d-1df0a58e9019'} Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:54.903763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:54.905225 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:54.906387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Returning 404 to user: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:54.906387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8f44a431-3e07-489b-9b39-555f54fa93ee tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 404 len: 111 microversion: 2.1 time: 0.036700 Sep 01 16:44:54.906387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 570/1154] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:54 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:44:54.913716 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-81405fad-a2b8-441a-8158-656aa6eb3bb6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '.version_select at 0x7fe37a2fa8b0>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:55.005641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-81405fad-a2b8-441a-8158-656aa6eb3bb6 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149890991" status: 202 len: 0 microversion: 2.1 time: 0.096270 Sep 01 16:44:55.010408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 585/1155] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 1 16:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149890991 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:44:58.567360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:58.567977 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:58.574855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:58.575444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:58.575872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:58.576561 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:58.577006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:58.577420 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:58.592506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] HTTP exception thrown: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Request method failure captured: Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 HTTP/1.1 Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7Hufjvuzg0MlUpGchlhUdKmcwC-6ghPWMG6-QE-KzERxQoU60gi542NDyqs0BYwcCweLi-bkWIZpnoGLqF9aZnucFAfU70l5wQJ4ieLVwgWxnjBjtUHsUGJbFoHRFFhPfOToAnKWsP-TYuTRHZh-o1BxoT5Fx2g5t5n55b0r45Fkc Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:44:58.594054 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c787c684c86144c792d9afc457ac3212", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 21e6ff7908e84a5994a51be0cfc82414 Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.595537 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '70e4fec9-b6c8-4535-a00d-1df0a58e9019'} Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:58.596325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.598384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.599682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Returning 404 to user: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:58.599682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b4acf703-ae7a-439a-a784-5b23fba6907c tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 404 len: 111 microversion: 2.1 time: 0.032111 Sep 01 16:44:58.599682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 571/1156] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:44:58 2022] DELETE /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:44:58.606086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:58.606780 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: 70e4fec9-b6c8-4535-a00d-1df0a58e9019] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:58.614550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:58.615031 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:58.615487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:58.616179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:58.616624 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:58.617043 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:58.630524 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] HTTP exception thrown: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Request method failure captured: Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 HTTP/1.1 Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7Hufjvuzg0MlUpGchlhUdKmcwC-6ghPWMG6-QE-KzERxQoU60gi542NDyqs0BYwcCweLi-bkWIZpnoGLqF9aZnucFAfU70l5wQJ4ieLVwgWxnjBjtUHsUGJbFoHRFFhPfOToAnKWsP-TYuTRHZh-o1BxoT5Fx2g5t5n55b0r45Fkc Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:44:58.632246 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c787c684c86144c792d9afc457ac3212", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 21e6ff7908e84a5994a51be0cfc82414 Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.633890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '70e4fec9-b6c8-4535-a00d-1df0a58e9019'} Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:58.634733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. Sep 01 16:44:58.636018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:58.637642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Returning 404 to user: Instance 70e4fec9-b6c8-4535-a00d-1df0a58e9019 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:58.637642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-af2696ad-0847-46b3-a172-cbea30b37d96 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019" status: 404 len: 111 microversion: 2.1 time: 0.033085 Sep 01 16:44:58.637642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 586/1157] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:58 2022] GET /compute/v2.1/servers/70e4fec9-b6c8-4535-a00d-1df0a58e9019 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:44:59.860864 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:59.861374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:59.872595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:59.873086 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:59.873513 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:59.874208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:59.874783 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:59.875068 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:59.891584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] HTTP exception thrown: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Request method failure captured: Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 HTTP/1.1 Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7Hufjvuzg0MlUpGchlhUdKmcwC-6ghPWMG6-QE-KzERxQoU60gi542NDyqs0BYwcCweLi-bkWIZpnoGLqF9aZnucFAfU70l5wQJ4ieLVwgWxnjBjtUHsUGJbFoHRFFhPfOToAnKWsP-TYuTRHZh-o1BxoT5Fx2g5t5n55b0r45Fkc Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:44:59.893279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c787c684c86144c792d9afc457ac3212", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 21e6ff7908e84a5994a51be0cfc82414 Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.895107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'c9c562a4-a89a-4fb1-9f85-e9efa1183ff1'} Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:59.895934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.897447 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.898962 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Returning 404 to user: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:59.898962 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c3f16c51-72de-4cd3-87e7-fce9774e5906 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 404 len: 111 microversion: 2.1 time: 0.041790 Sep 01 16:44:59.898962 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 572/1158] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:44:59 2022] DELETE /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:44:59.908881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:59.911331 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] [instance: c9c562a4-a89a-4fb1-9f85-e9efa1183ff1] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:59.919571 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:59.920056 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:59.920792 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:59.921384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:59.921842 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:59.922256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:59.927920 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:59.938086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] HTTP exception thrown: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Request method failure captured: Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 HTTP/1.1 Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7Hufjvuzg0MlUpGchlhUdKmcwC-6ghPWMG6-QE-KzERxQoU60gi542NDyqs0BYwcCweLi-bkWIZpnoGLqF9aZnucFAfU70l5wQJ4ieLVwgWxnjBjtUHsUGJbFoHRFFhPfOToAnKWsP-TYuTRHZh-o1BxoT5Fx2g5t5n55b0r45Fkc Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:44:59.939960 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c787c684c86144c792d9afc457ac3212", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c787c684c86144c792d9afc457ac3212"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c787c684c86144c792d9afc457ac3212"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: c787c684c86144c792d9afc457ac3212 Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858831059 Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 21e6ff7908e84a5994a51be0cfc82414 Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeTestJSON-1858831059-project Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.941490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'c9c562a4-a89a-4fb1-9f85-e9efa1183ff1'} Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:59.942270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. Sep 01 16:44:59.943534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:44:59.946185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] Returning 404 to user: Instance c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:59.947303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-44889506-1c6e-4364-b1e6-0cb82baf65c9 tempest-AttachVolumeTestJSON-1858831059 tempest-AttachVolumeTestJSON-1858831059-project] 10.222.0.16 "GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1" status: 404 len: 111 microversion: 2.1 time: 0.044044 Sep 01 16:44:59.947876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 587/1159] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:59 2022] GET /compute/v2.1/servers/c9c562a4-a89a-4fb1-9f85-e9efa1183ff1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:01.607838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6f032465-e5e7-4444-9e24-423a00f95710 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Action: 'create', calling method: .version_select at 0x7fe37a1c0c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-78941208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6s8iDaWNYYOoKKxJjkFYY9dqgWOiApRRt/C1tL+r28wCkDMvETyE+rztQI9wMdbjj6H57wjF2emfLeZK8UJuWMJDdAl0yUqf8ozdGOs67VhKGa3xCw+GNp55dYEaJ+pw=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:01.633935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-6f032465-e5e7-4444-9e24-423a00f95710 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Getting quotas for project a58b7358110c43ebbfbb5b6de842c94b. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:45:01.639364 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-6f032465-e5e7-4444-9e24-423a00f95710 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Getting quotas for user edda03844073424d89deff3eafeae7cb and project a58b7358110c43ebbfbb5b6de842c94b. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:45:01.767097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6f032465-e5e7-4444-9e24-423a00f95710 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.413728 Sep 01 16:45:01.767840 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 573/1160] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:45:01 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:09.234524 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7b285aa8-e4d3-4eed-929e-baa64681c07b tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37a0a6ee0>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:09.307051 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7b285aa8-e4d3-4eed-929e-baa64681c07b tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/30daf215-07b3-48de-88d2-83388026a84d" status: 200 len: 350 microversion: 2.1 time: 0.070919 Sep 01 16:45:09.307051 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 588/1161] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:45:09 2022] GET /compute/v2.1/os-volumes/30daf215-07b3-48de-88d2-83388026a84d => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:45:12.039456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:12.040522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:45:12.040848 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Thu Sep 1 16:45:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0666dd59-250f-4680-9677-9acfc089d8a1 (ip 10.222.0.16) !!! Sep 01 16:45:12.042196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:12.043332 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:12.047509 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dd234c1a-5870-4ff8-818f-d04a3a55c396 tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37a1c63a0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:12.100115 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dd234c1a-5870-4ff8-818f-d04a3a55c396 tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0666dd59-250f-4680-9677-9acfc089d8a1" status: 200 len: 350 microversion: 2.1 time: 0.062630 Sep 01 16:45:12.100632 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 574/1162] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:45:12 2022] GET /compute/v2.1/os-volumes/0666dd59-250f-4680-9677-9acfc089d8a1 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:14.842930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:14.848826 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-897687fa-3164-4311-96b4-36386726b0bb tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37a25ee50>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:14.906546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-897687fa-3164-4311-96b4-36386726b0bb tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/bdf96c86-923c-4c16-b6a7-76063e9f4979" status: 200 len: 348 microversion: 2.1 time: 0.064052 Sep 01 16:45:14.908155 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 589/1163] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:45:14 2022] GET /compute/v2.1/os-volumes/bdf96c86-923c-4c16-b6a7-76063e9f4979 => generated 348 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:14.921005 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-05f47a50-b8d8-4d3b-8918-ab78c95a79bd tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37a04b430>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:15.011124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-05f47a50-b8d8-4d3b-8918-ab78c95a79bd tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.095076 Sep 01 16:45:15.011724 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 575/1164] 10.222.0.16 () {58 vars in 1134 bytes} [Thu Sep 1 16:45:14 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:15.026429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-d8274a51-37de-4a23-b4fb-3dbcf1e3390c tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37a291820>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:15.120352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-d8274a51-37de-4a23-b4fb-3dbcf1e3390c tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.097573 Sep 01 16:45:15.121118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 590/1165] 10.222.0.16 () {58 vars in 1149 bytes} [Thu Sep 1 16:45:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 691 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:15.136716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d8c97786-5f55-428d-8f55-3eb6d4b2941d tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37a027ca0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:15.234648 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d8c97786-5f55-428d-8f55-3eb6d4b2941d tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.102772 Sep 01 16:45:15.235360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 576/1166] 10.222.0.16 () {58 vars in 1134 bytes} [Thu Sep 1 16:45:15 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:15.250077 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cc2c697c-75c2-4fa0-b33f-c23ad99bcf8a tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37d874160>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:15.335763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cc2c697c-75c2-4fa0-b33f-c23ad99bcf8a tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090141 Sep 01 16:45:15.336434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 591/1167] 10.222.0.16 () {58 vars in 1167 bytes} [Thu Sep 1 16:45:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:15.351048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f3e104ca-53d1-4486-98ba-fdf58efced6e tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37d8cbf70>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:15.438197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f3e104ca-53d1-4486-98ba-fdf58efced6e tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.091484 Sep 01 16:45:15.439495 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 577/1168] 10.222.0.16 () {58 vars in 1170 bytes} [Thu Sep 1 16:45:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 691 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:15.452733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-21879c0a-227a-4e30-99b9-59eba0722b87 tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37a182280>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:15.545191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-21879c0a-227a-4e30-99b9-59eba0722b87 tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.096143 Sep 01 16:45:15.545846 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 592/1169] 10.222.0.16 () {58 vars in 1155 bytes} [Thu Sep 1 16:45:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:15.558837 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7bf81b92-73f6-4b5d-93fa-f837b4eb07d4 tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe37d8a8e50>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:15.646698 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7bf81b92-73f6-4b5d-93fa-f837b4eb07d4 tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091481 Sep 01 16:45:15.647558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 578/1170] 10.222.0.16 () {58 vars in 1188 bytes} [Thu Sep 1 16:45:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:15.661578 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a0f27c7c-82d5-428a-b6bc-ba6adbb136d8 tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] Calling method '.version_select at 0x7fe379fe3a60>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:15.744327 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a0f27c7c-82d5-428a-b6bc-ba6adbb136d8 tempest-VolumesTestJSON-528026980 tempest-VolumesTestJSON-528026980-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.086988 Sep 01 16:45:15.744903 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 593/1171] 10.222.0.16 () {58 vars in 1155 bytes} [Thu Sep 1 16:45:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:22.831486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1921caa4-f7b3-405c-aef1-a4d13d00bde4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:22.832071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1921caa4-f7b3-405c-aef1-a4d13d00bde4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:22.840402 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1921caa4-f7b3-405c-aef1-a4d13d00bde4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:22.840902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1921caa4-f7b3-405c-aef1-a4d13d00bde4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:22.841344 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1921caa4-f7b3-405c-aef1-a4d13d00bde4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:22.842048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1921caa4-f7b3-405c-aef1-a4d13d00bde4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:22.842511 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1921caa4-f7b3-405c-aef1-a4d13d00bde4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:22.843070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1921caa4-f7b3-405c-aef1-a4d13d00bde4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:22.870595 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1921caa4-f7b3-405c-aef1-a4d13d00bde4 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/ips" status: 200 len: 150 microversion: 2.1 time: 0.250189 Sep 01 16:45:22.872177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 579/1172] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:45:22 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/ips => generated 150 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:25.520965 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:25.525198 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f16b8fcc-b68e-4d6e-ad27-4bcaa5dd1081 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37d77f29-b9df-4768-beb8-b536cfb566ca"}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:25.527741 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f16b8fcc-b68e-4d6e-ad27-4bcaa5dd1081 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:25.535945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f16b8fcc-b68e-4d6e-ad27-4bcaa5dd1081 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.536522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f16b8fcc-b68e-4d6e-ad27-4bcaa5dd1081 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.537085 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f16b8fcc-b68e-4d6e-ad27-4bcaa5dd1081 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:25.537930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f16b8fcc-b68e-4d6e-ad27-4bcaa5dd1081 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.538437 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f16b8fcc-b68e-4d6e-ad27-4bcaa5dd1081 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.539000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f16b8fcc-b68e-4d6e-ad27-4bcaa5dd1081 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:26.481356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f16b8fcc-b68e-4d6e-ad27-4bcaa5dd1081 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "POST /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.961526 Sep 01 16:45:26.482150 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 594/1173] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 16:45:25 2022] POST /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments => generated 194 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:30.956683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-208501353", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-78941208", "security_groups": [{"name": "tempest-secgroup-smoke-2089977687"}], "networks": [{"uuid": "dc7d636d-05f7-4b33-a3c7-28843c0a6cc5"}], "block_device_mapping_v2": [{"uuid": "86de3eb4-5be7-46b4-8172-4b9e8b55fcaf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:31.130199 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] validate_networks() for [('dc7d636d-05f7-4b33-a3c7-28843c0a6cc5', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:45:31.782384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:45:31.782954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:45:31.783680 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:45:31.784091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:45:31.784503 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:45:31.798552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:31.798552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:31.798552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:31.798552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:31.799034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:31.799034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:31.813304 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Getting quotas for project a58b7358110c43ebbfbb5b6de842c94b. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:45:31.817482 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Getting quotas for user edda03844073424d89deff3eafeae7cb and project a58b7358110c43ebbfbb5b6de842c94b. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:45:31.881256 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:45:31.883825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86de3eb4-5be7-46b4-8172-4b9e8b55fcaf',volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:45:32.427830 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8c9522dd-e49f-4dd4-821d-2db3d534926b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.475931 Sep 01 16:45:32.428960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 580/1174] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:45:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:45:32.444531 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1434932f-1f5e-4af3-915e-f9b0fb217723 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:32.445974 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1434932f-1f5e-4af3-915e-f9b0fb217723 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:32.502283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1434932f-1f5e-4af3-915e-f9b0fb217723 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:32.509592 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1434932f-1f5e-4af3-915e-f9b0fb217723 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1086 microversion: 2.1 time: 0.070231 Sep 01 16:45:32.510739 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 595/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:32 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1086 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:45:33.532410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:33.533171 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:33.540220 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:33.540708 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:33.541234 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:33.541847 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:33.542299 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:33.542716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:33.611325 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:33.619513 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b434c8d1-04c1-4836-9226-6fcaba278623 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1136 microversion: 2.1 time: 0.092160 Sep 01 16:45:33.620079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 581/1176] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:33 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1136 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:34.299873 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-827c3267-d503-40cf-ac7f-d76970b2124d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:34.303653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-827c3267-d503-40cf-ac7f-d76970b2124d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:34.318807 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-827c3267-d503-40cf-ac7f-d76970b2124d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.319628 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-827c3267-d503-40cf-ac7f-d76970b2124d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.320392 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-827c3267-d503-40cf-ac7f-d76970b2124d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.321501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-827c3267-d503-40cf-ac7f-d76970b2124d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.322286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-827c3267-d503-40cf-ac7f-d76970b2124d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.322986 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-827c3267-d503-40cf-ac7f-d76970b2124d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.373717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-827c3267-d503-40cf-ac7f-d76970b2124d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080188 Sep 01 16:45:34.374936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 596/1177] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 1 16:45:34 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:34.446873 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:34.447499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:34.454095 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.454586 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.455031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.456229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.456687 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.457114 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.485098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:45:34.640871 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:34.641487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:34.648055 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.648542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.648968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.649672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.650122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.650536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.720197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:34.728232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e95e8180-dccb-4f04-b85b-a5869ea310c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1184 microversion: 2.1 time: 0.092004 Sep 01 16:45:34.728819 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 597/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:34 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1184 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:34.892970 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-33688266-7ae4-4b7e-91d9-3729c35ddb62 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 204 len: 0 microversion: 2.20 time: 0.449838 Sep 01 16:45:34.893606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 582/1179] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 1 16:45:34 2022] DELETE /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:45:34.903630 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:34.904214 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:34.910903 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.911424 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.911860 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.912564 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.913210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.913633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:35.054507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:35.063685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:35.065142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:35.066576 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1a54e701-8a1e-4959-8756-beb0245ba10c tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.167073 Sep 01 16:45:35.067140 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 598/1180] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:45:34 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:45:35.276850 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:35.277437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:35.284015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:35.284661 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:35.285105 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:35.285803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:35.286256 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:35.286681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:35.373338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lazy-loading 'services' on Instance uuid 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:45:35.617209 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8a83742f-1824-4d82-8d7a-329720e99064 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments/37d77f29-b9df-4768-beb8-b536cfb566ca" status: 202 len: 0 microversion: 2.1 time: 0.344526 Sep 01 16:45:35.617846 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 583/1181] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 16:45:35 2022] DELETE /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments/37d77f29-b9df-4768-beb8-b536cfb566ca => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:45:35.626958 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a43277ee-2b92-4e4f-ade9-aa7a0c6db07c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:35.629134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a43277ee-2b92-4e4f-ade9-aa7a0c6db07c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:35.635693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a43277ee-2b92-4e4f-ade9-aa7a0c6db07c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:35.636168 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a43277ee-2b92-4e4f-ade9-aa7a0c6db07c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:35.636595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a43277ee-2b92-4e4f-ade9-aa7a0c6db07c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:35.637283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a43277ee-2b92-4e4f-ade9-aa7a0c6db07c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:35.637728 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a43277ee-2b92-4e4f-ade9-aa7a0c6db07c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:35.638143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a43277ee-2b92-4e4f-ade9-aa7a0c6db07c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:35.670877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a43277ee-2b92-4e4f-ade9-aa7a0c6db07c tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048354 Sep 01 16:45:35.671490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 599/1182] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:45:35 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:35.750932 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:35.751716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:35.758757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:35.759539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:35.759895 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:35.760724 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:35.761218 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:35.761684 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:35.831539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:35.839419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6bab5e61-9df0-4a45-8b26-3f23d075586a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1192 microversion: 2.1 time: 0.093461 Sep 01 16:45:35.840032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 584/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:35 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:36.090550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:36.091072 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:36.097346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.097829 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.098256 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.098941 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.099540 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.099961 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.555073 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:36.564926 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:36.566641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:36.567844 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-be2af738-468e-4920-abea-5d3c1c9dcf2b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.481389 Sep 01 16:45:36.568599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 600/1184] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:45:36 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:45:36.683462 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2842706d-33a9-4395-8bda-b138882f4868 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:36.685639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2842706d-33a9-4395-8bda-b138882f4868 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:36.692606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2842706d-33a9-4395-8bda-b138882f4868 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.693096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2842706d-33a9-4395-8bda-b138882f4868 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.693516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2842706d-33a9-4395-8bda-b138882f4868 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.694197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2842706d-33a9-4395-8bda-b138882f4868 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.694642 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2842706d-33a9-4395-8bda-b138882f4868 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.695059 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2842706d-33a9-4395-8bda-b138882f4868 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.728237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2842706d-33a9-4395-8bda-b138882f4868 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048037 Sep 01 16:45:36.728237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 585/1185] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:45:36 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:36.862113 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:36.862700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:36.869428 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.869906 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.870336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.871026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.871498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.871917 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.934954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:36.943774 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f67a769d-fc9c-4d0c-8dfa-75eb4fac01e5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1202 microversion: 2.1 time: 0.086120 Sep 01 16:45:36.944432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 601/1186] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:36 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:37.599957 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:37.601417 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:37.608472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.608961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.609788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.610828 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.611527 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.612107 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.740325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1d347fc8-6ec7-4db9-a12d-b5d8901d5f5f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:37.742558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1d347fc8-6ec7-4db9-a12d-b5d8901d5f5f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:37.758792 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d347fc8-6ec7-4db9-a12d-b5d8901d5f5f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.759640 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d347fc8-6ec7-4db9-a12d-b5d8901d5f5f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.760238 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d347fc8-6ec7-4db9-a12d-b5d8901d5f5f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.761836 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d347fc8-6ec7-4db9-a12d-b5d8901d5f5f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.762633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d347fc8-6ec7-4db9-a12d-b5d8901d5f5f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.763481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1d347fc8-6ec7-4db9-a12d-b5d8901d5f5f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.812791 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1d347fc8-6ec7-4db9-a12d-b5d8901d5f5f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076308 Sep 01 16:45:37.813724 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 602/1187] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 16:45:37 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 16:45:37.891727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:37.892435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:37.903209 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.903931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.905158 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.908316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.908316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.908986 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.938118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:45:38.074476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:38.087644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:38.089174 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:38.096607 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-79368115-2ce4-4824-8074-161d4c5f8401 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1723 microversion: 2.20 time: 0.507132 Sep 01 16:45:38.107176 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 586/1188] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:45:37 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1723 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:45:38.112474 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:38.113235 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:38.128444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.128444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.128444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.130935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.134754 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.135390 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.221953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:38.236049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b19e37e-2b2b-4a4d-8265-1c32b9cf2092 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1202 microversion: 2.1 time: 0.137096 Sep 01 16:45:38.236894 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 587/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:38 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1202 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:38.362447 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8b2a2160-4c4d-40d0-a5b9-06dfd50a99d7 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 204 len: 0 microversion: 2.1 time: 0.475649 Sep 01 16:45:38.367230 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 603/1190] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:37 2022] DELETE /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:45:38.371919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:38.372538 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:38.379254 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.379752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.380183 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.381065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.381527 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.381950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.632306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:38.644936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-207bdf82-54ce-4079-b7eb-cd79659efce6 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1681 microversion: 2.1 time: 0.276868 Sep 01 16:45:38.647194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 588/1191] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:38 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1681 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:45:38.756002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-511165ca-3a7c-41b4-addf-d4b0f98a750d req-b4e1ff1f-46a7-412d-8780-2222bddbc8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3", "name": "network-vif-deleted", "tag": "611fe9aa-a99e-4482-9ba2-a177311f9a82"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:38.773452 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-511165ca-3a7c-41b4-addf-d4b0f98a750d req-b4e1ff1f-46a7-412d-8780-2222bddbc8bc service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.774027 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-511165ca-3a7c-41b4-addf-d4b0f98a750d req-b4e1ff1f-46a7-412d-8780-2222bddbc8bc service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.774515 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-511165ca-3a7c-41b4-addf-d4b0f98a750d req-b4e1ff1f-46a7-412d-8780-2222bddbc8bc service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.790289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-511165ca-3a7c-41b4-addf-d4b0f98a750d req-b4e1ff1f-46a7-412d-8780-2222bddbc8bc service nova] Creating event network-vif-deleted:611fe9aa-a99e-4482-9ba2-a177311f9a82 for instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 on hv-cinder-83602 Sep 01 16:45:38.795828 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-511165ca-3a7c-41b4-addf-d4b0f98a750d req-b4e1ff1f-46a7-412d-8780-2222bddbc8bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282511 Sep 01 16:45:38.796913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 604/1192] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:39.123713 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:39.124372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:39.132802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.133458 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.133899 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.134645 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.135101 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.135558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.206234 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:39.215382 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:39.221121 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:39.221121 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-70871483-83e8-4745-b77b-126567e21bbc tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1655 microversion: 2.20 time: 0.099816 Sep 01 16:45:39.221121 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 589/1193] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:45:39 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1655 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:45:39.263348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:39.264729 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:39.271752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.272307 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.272828 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.273598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.274119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.274611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.439380 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:39.448781 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-baf0522e-d563-4ecb-8b22-9f5051c79d40 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1270 microversion: 2.1 time: 0.195123 Sep 01 16:45:39.449401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 605/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:39 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:39.668067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:39.668858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:39.676646 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.677136 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.677609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.678357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.678809 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.679282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.838090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:39.847805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d88ef56b-6b01-4ce7-ba99-3cc29a6a5333 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1681 microversion: 2.1 time: 0.183825 Sep 01 16:45:39.848403 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 590/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:39 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:40.242638 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:40.245423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:40.272310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.273408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.273881 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.276552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.277917 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.280951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.328690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.329161 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.330379 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.330837 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lazy-loading 'fault' on Instance uuid a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:45:40.389281 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:40.399867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:40.401528 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:40.402892 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-979310e1-c6cd-40c3-936c-c184b6a174d0 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1371 microversion: 2.20 time: 0.164788 Sep 01 16:45:40.403517 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 606/1196] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:45:40 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:45:40.471142 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:40.472374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:40.479119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.479825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.480253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.480941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.481384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.481811 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.562180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-a1af2912-adcf-484f-9e9d-d4efe45fd6c4 req-02265e7d-c712-450c-88c9-4e23b54b0427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a4592d-070c-4611-93a5-ee770b7e9ed7", "tag": "4d49de64-8086-4086-8c06-bc6923d76693"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:40.574531 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-a1af2912-adcf-484f-9e9d-d4efe45fd6c4 req-02265e7d-c712-450c-88c9-4e23b54b0427 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.574861 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-a1af2912-adcf-484f-9e9d-d4efe45fd6c4 req-02265e7d-c712-450c-88c9-4e23b54b0427 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.575645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-a1af2912-adcf-484f-9e9d-d4efe45fd6c4 req-02265e7d-c712-450c-88c9-4e23b54b0427 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.621869 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-a1af2912-adcf-484f-9e9d-d4efe45fd6c4 req-02265e7d-c712-450c-88c9-4e23b54b0427 service nova] Creating event network-changed:4d49de64-8086-4086-8c06-bc6923d76693 for instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 on hv-cinder-83602 Sep 01 16:45:40.632357 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-a1af2912-adcf-484f-9e9d-d4efe45fd6c4 req-02265e7d-c712-450c-88c9-4e23b54b0427 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074003 Sep 01 16:45:40.635373 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 607/1197] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:40.676666 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-d0c33df0-9d3c-4e22-a970-04202b234522 req-a891a01a-2d8b-497d-8dff-8b75c78b416d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aca35b2-1f66-49bb-b9c2-7653ef1e83fd", "name": "network-vif-unplugged", "status": "completed", "tag": "1f8ad264-6f25-4cb8-8762-f0b82941a4c4"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:40.687869 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-d0c33df0-9d3c-4e22-a970-04202b234522 req-a891a01a-2d8b-497d-8dff-8b75c78b416d service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.688355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-d0c33df0-9d3c-4e22-a970-04202b234522 req-a891a01a-2d8b-497d-8dff-8b75c78b416d service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.688782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-d0c33df0-9d3c-4e22-a970-04202b234522 req-a891a01a-2d8b-497d-8dff-8b75c78b416d service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.700427 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-d0c33df0-9d3c-4e22-a970-04202b234522 req-a891a01a-2d8b-497d-8dff-8b75c78b416d service nova] Creating event network-vif-unplugged:1f8ad264-6f25-4cb8-8762-f0b82941a4c4 for instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd on hv-cinder-83602 Sep 01 16:45:40.705513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-d0c33df0-9d3c-4e22-a970-04202b234522 req-a891a01a-2d8b-497d-8dff-8b75c78b416d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033464 Sep 01 16:45:40.706818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 608/1198] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:40.717823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:40.726108 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d4022c3c-0921-4632-bef9-9b8463436068 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.259763 Sep 01 16:45:40.726689 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 591/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:40 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:40.873612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:40.874891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:40.882943 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.883655 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.884264 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.884952 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.885403 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.885816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.117669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:41.131061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-299da6f4-f4a8-416e-bf50-5cb3be206378 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1681 microversion: 2.1 time: 0.264176 Sep 01 16:45:41.132644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 609/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:40 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1681 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:41.432740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:41.432740 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:41.433964 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.434629 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.435065 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.435800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.436250 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.436698 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.482012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.483351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.484431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.484955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lazy-loading 'fault' on Instance uuid a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:45:41.570009 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:41.579567 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:41.581432 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab4df1724851433889a519583a5333b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14e9793530a41bbab5bd4b3caecdb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:41.582706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-86742866-ecdb-4a4d-bb8a-ecd55c58f819 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 200 len: 1371 microversion: 2.20 time: 0.160584 Sep 01 16:45:41.583502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 592/1201] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:45:41 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:45:41.747827 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:41.749037 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:41.757093 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.757733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.758358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.759895 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.761036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.761265 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.767016 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:41.916717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:41.925898 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3de7003f-c6af-42b1-a70e-eed16218b53a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.181676 Sep 01 16:45:41.940080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 610/1202] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:41 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:41.967849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-b3da2128-f320-4121-8d0c-197563386426 req-51789560-bdd2-450d-988f-99d80716466c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aca35b2-1f66-49bb-b9c2-7653ef1e83fd", "name": "network-vif-deleted", "tag": "1f8ad264-6f25-4cb8-8762-f0b82941a4c4"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:41.973967 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:41.974775 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:41.981411 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-b3da2128-f320-4121-8d0c-197563386426 req-51789560-bdd2-450d-988f-99d80716466c service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.981953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-b3da2128-f320-4121-8d0c-197563386426 req-51789560-bdd2-450d-988f-99d80716466c service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.982476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-b3da2128-f320-4121-8d0c-197563386426 req-51789560-bdd2-450d-988f-99d80716466c service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.995980 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-b3da2128-f320-4121-8d0c-197563386426 req-51789560-bdd2-450d-988f-99d80716466c service nova] Creating event network-vif-deleted:1f8ad264-6f25-4cb8-8762-f0b82941a4c4 for instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd on hv-cinder-83602 Sep 01 16:45:42.002172 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-b3da2128-f320-4121-8d0c-197563386426 req-51789560-bdd2-450d-988f-99d80716466c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037706 Sep 01 16:45:42.002858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 593/1203] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:42.158907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:42.160010 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:42.169034 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.169810 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.170421 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.173600 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.174068 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.174575 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.282785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:42.291587 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b859cd43-a3a8-430d-a57d-09a810e9716d tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1614 microversion: 2.1 time: 0.141359 Sep 01 16:45:42.292206 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 611/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:42 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1614 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:42.606367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:42.607062 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:42.614404 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.614884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.615351 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.616048 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.616506 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.616931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.631273 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] HTTP exception thrown: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Request method failure captured: Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 HTTP/1.1 Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7FIe7N8EMhgjpULOxJK4YaiEv4LW3SkHHa7SoCXEu4nIfyEZKU110N6VzyL18zGsgr3Vi6gPUEftHgpEM1gEO8o4IrrmjUP8goDk8uOpU7x-kvfr5_lXpHMsoC2ytTjCKaiHaw81MK_GVmsWcRCl-Q8Ydl84qIIEwuNZ45YM9-OWM Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:45:42.632945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b14e9793530a41bbab5bd4b3caecdb3c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: ab4df1724851433889a519583a5333b3 Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:42.634434 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3'} Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:42.635253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:42.643548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:42.644838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Returning 404 to user: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:42.644838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3468c27e-ace0-401d-b2f8-b61e7e5c5cc8 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 404 len: 111 microversion: 2.20 time: 0.032922 Sep 01 16:45:42.644838 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 594/1205] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:45:42 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:45:42.645055 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-62ad411d-c3b8-4675-9518-df37fdb87f08 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '.version_select at 0x7fe379fe3af0>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:42.648700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:42.779042 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-62ad411d-c3b8-4675-9518-df37fdb87f08 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179711177" status: 204 len: 0 microversion: 2.20 time: 0.139569 Sep 01 16:45:42.779897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 612/1206] 10.222.0.16 () {60 vars in 1262 bytes} [Thu Sep 1 16:45:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179711177 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:45:42.948942 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:42.949561 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:42.956903 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.957442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.958030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.959089 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.960374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.961008 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.966768 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:43.136515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:43.149460 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a8beabfe-f2fa-4805-829b-52956f9833b7 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.204271 Sep 01 16:45:43.150673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 595/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:42 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:43.314541 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:43.315614 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:43.326996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:43.328209 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:43.328353 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:43.329038 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:43.329685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:43.330106 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:43.363717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:43.364413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:43.365015 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:43.365467 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lazy-loading 'fault' on Instance uuid 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:45:43.424629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45ee95cf5947c49584ff403facaff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a994270b8e1f43328b827696f9d89bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:43.433838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bf28dab1-debd-45da-83a9-b1b337ad0a1f tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 200 len: 1331 microversion: 2.1 time: 0.123541 Sep 01 16:45:43.434591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 613/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:43 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:44.169936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:44.170499 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:44.180383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:44.181119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:44.181983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:44.182843 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:44.183324 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:44.183745 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:44.322713 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:44.331273 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-81d7adae-128f-426b-b326-73238de79845 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.165220 Sep 01 16:45:44.331845 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 596/1209] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:44 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:44.469645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:44.469645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:44.469645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:44.469645 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:44.470667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:44.470667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:44.470667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:44.470667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:44.482496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd HTTP/1.1 Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:44.485164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:44.486835 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '1aca35b2-1f66-49bb-b9c2-7653ef1e83fd'} Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:44.487797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:44.489090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:44.490270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:44.490270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b8302b1f-1c47-49d9-982a-a83aa3ef6a77 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 404 len: 111 microversion: 2.1 time: 0.034158 Sep 01 16:45:44.490270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 614/1210] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:44 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:44.495548 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-512fdf95-af01-40c7-9b08-3de5d4b1fdbb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '.version_select at 0x7fe37a1c0940>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:44.635882 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-512fdf95-af01-40c7-9b08-3de5d4b1fdbb tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551677473" status: 202 len: 0 microversion: 2.1 time: 0.144123 Sep 01 16:45:44.636654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 597/1211] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 1 16:45:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551677473 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:45:45.094125 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:45.094818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:45.101386 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.108367 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.108367 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.108367 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.108367 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.109319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.119555 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] HTTP exception thrown: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Request method failure captured: Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: DELETE /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 HTTP/1.1 Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7FIe7N8EMhgjpULOxJK4YaiEv4LW3SkHHa7SoCXEu4nIfyEZKU110N6VzyL18zGsgr3Vi6gPUEftHgpEM1gEO8o4IrrmjUP8goDk8uOpU7x-kvfr5_lXpHMsoC2ytTjCKaiHaw81MK_GVmsWcRCl-Q8Ydl84qIIEwuNZ45YM9-OWM Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:45.121514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b14e9793530a41bbab5bd4b3caecdb3c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: ab4df1724851433889a519583a5333b3 Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.123550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3'} Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:45.124505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.126050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.128107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Returning 404 to user: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:45.128107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2ddb2f81-afce-499f-9926-98fc5b2f6227 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 404 len: 111 microversion: 2.20 time: 0.034671 Sep 01 16:45:45.128107 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 615/1212] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 1 16:45:45 2022] DELETE /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:45:45.135306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:45.135930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:45.137763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:45.145138 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.145716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.146261 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.147221 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.148079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.148630 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.164674 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] HTTP exception thrown: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Request method failure captured: Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 HTTP/1.1 Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7FIe7N8EMhgjpULOxJK4YaiEv4LW3SkHHa7SoCXEu4nIfyEZKU110N6VzyL18zGsgr3Vi6gPUEftHgpEM1gEO8o4IrrmjUP8goDk8uOpU7x-kvfr5_lXpHMsoC2ytTjCKaiHaw81MK_GVmsWcRCl-Q8Ydl84qIIEwuNZ45YM9-OWM Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:45:45.174861 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b14e9793530a41bbab5bd4b3caecdb3c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: ab4df1724851433889a519583a5333b3 Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.177072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3'} Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:45.177944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. Sep 01 16:45:45.179953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:45.181800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Returning 404 to user: Instance a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:45.181800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b3a6bc56-116b-4f8c-bbce-f09a52d7103b tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3" status: 404 len: 111 microversion: 2.20 time: 0.038846 Sep 01 16:45:45.181800 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 598/1213] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:45:45 2022] GET /compute/v2.1/servers/a8cc62e6-a0f1-4ea5-8b3c-7a5a08d441a3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:45:45.351740 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:45.352685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:45.359639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.360117 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.360546 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.363767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.363767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.363767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.513203 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:45.521254 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-48384fe5-bfb9-4d4c-9b80-68e21655be35 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.173729 Sep 01 16:45:45.535498 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 616/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:45 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:46.544021 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:46.544627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:46.552259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.552733 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.553172 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.553867 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.554677 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.554788 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.584913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:46.585775 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:46.592442 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.593031 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.593565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.594552 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.595128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.595644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.615504 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] HTTP exception thrown: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Request method failure captured: Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: DELETE /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f HTTP/1.1 Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7FIe7N8EMhgjpULOxJK4YaiEv4LW3SkHHa7SoCXEu4nIfyEZKU110N6VzyL18zGsgr3Vi6gPUEftHgpEM1gEO8o4IrrmjUP8goDk8uOpU7x-kvfr5_lXpHMsoC2ytTjCKaiHaw81MK_GVmsWcRCl-Q8Ydl84qIIEwuNZ45YM9-OWM Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:46.617232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b14e9793530a41bbab5bd4b3caecdb3c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: ab4df1724851433889a519583a5333b3 Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.618972 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f'} Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:46.619945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.621466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.622701 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Returning 404 to user: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:46.622701 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-66a8f683-cf2a-485c-a3ec-335cd2fb3076 tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 404 len: 111 microversion: 2.20 time: 0.039831 Sep 01 16:45:46.622701 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 617/1215] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 1 16:45:46 2022] DELETE /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:45:46.630558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:46.631126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] [instance: aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:46.637580 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.638075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.638512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.639249 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.640921 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.640921 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.657771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] HTTP exception thrown: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Request method failure captured: Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f HTTP/1.1 Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7FIe7N8EMhgjpULOxJK4YaiEv4LW3SkHHa7SoCXEu4nIfyEZKU110N6VzyL18zGsgr3Vi6gPUEftHgpEM1gEO8o4IrrmjUP8goDk8uOpU7x-kvfr5_lXpHMsoC2ytTjCKaiHaw81MK_GVmsWcRCl-Q8Ydl84qIIEwuNZ45YM9-OWM Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:46.659414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b14e9793530a41bbab5bd4b3caecdb3c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b14e9793530a41bbab5bd4b3caecdb3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: b14e9793530a41bbab5bd4b3caecdb3c Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-794603850 Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: ab4df1724851433889a519583a5333b3 Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-794603850-project Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.660944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f'} Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:46.661726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. Sep 01 16:45:46.663070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:46.664499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] Returning 404 to user: Instance aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:46.664499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2afc053d-671b-4a07-ae0d-450d07de5d4d tempest-AttachVolumeShelveTestJSON-794603850 tempest-AttachVolumeShelveTestJSON-794603850-project] 10.222.0.16 "GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f" status: 404 len: 111 microversion: 2.20 time: 0.035527 Sep 01 16:45:46.664499 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 618/1216] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 16:45:46 2022] GET /compute/v2.1/servers/aa8c7b1f-d27a-4b0f-837c-3cd90a1c190f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:45:46.725687 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:46.735238 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7bb82f37-e5d1-4414-8834-e4330001f781 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.196144 Sep 01 16:45:46.735825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 599/1217] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:46 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:47.030526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:47.031082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:47.038951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.039798 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.040233 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.041377 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.041839 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.042258 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.057779 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: DELETE /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd HTTP/1.1 Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:47.059536 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.060951 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '1aca35b2-1f66-49bb-b9c2-7653ef1e83fd'} Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:47.062522 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.063894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.065548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:47.065548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0693e438-cde1-4655-83a8-618ba76d2281 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 404 len: 111 microversion: 2.1 time: 0.034379 Sep 01 16:45:47.065548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 619/1218] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:47 2022] DELETE /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:47.070627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:47.071451 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:47.078510 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.078967 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.079570 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.079863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.085987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.085987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.096019 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd HTTP/1.1 Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:45:47.097362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.098796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '1aca35b2-1f66-49bb-b9c2-7653ef1e83fd'} Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:47.099795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. Sep 01 16:45:47.102606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:47.109804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance 1aca35b2-1f66-49bb-b9c2-7653ef1e83fd could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:47.109804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7df11923-1d11-4f3c-9138-3a3d41bac5c2 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd" status: 404 len: 111 microversion: 2.1 time: 0.031936 Sep 01 16:45:47.109804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 600/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:47 2022] GET /compute/v2.1/servers/1aca35b2-1f66-49bb-b9c2-7653ef1e83fd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:47.755451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:47.756059 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:47.762649 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.763132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.763647 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.764336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.765310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.765732 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.017610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:48.028644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b218b9b4-fd70-47a9-a7c7-90112c7c9664 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.276885 Sep 01 16:45:48.029452 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 620/1220] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:47 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:48.416392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:48.418104 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:48.428690 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.429308 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.429738 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.430462 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.430907 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.431352 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.448933 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf HTTP/1.1 Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:45:48.450485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.452175 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '65d5141e-06e1-45b2-ad7a-11ae9de1a0bf'} Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:48.453072 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.454881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.457515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:48.457515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-627b1c8c-927c-426e-912a-6bd965906787 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 404 len: 111 microversion: 2.1 time: 0.041198 Sep 01 16:45:48.457515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 601/1221] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:48 2022] DELETE /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:48.461313 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:48.462126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:48.468700 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.469209 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.477635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.477635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.477635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.477635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.485597 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf HTTP/1.1 Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:48.487134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.488551 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '65d5141e-06e1-45b2-ad7a-11ae9de1a0bf'} Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:48.489406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. Sep 01 16:45:48.490823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.492016 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance 65d5141e-06e1-45b2-ad7a-11ae9de1a0bf could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:48.492016 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ad340778-1be7-4fbb-a7ec-bd3b5d02cd6a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf" status: 404 len: 111 microversion: 2.1 time: 0.031626 Sep 01 16:45:48.492016 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 621/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:48 2022] GET /compute/v2.1/servers/65d5141e-06e1-45b2-ad7a-11ae9de1a0bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:48.497558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:48.498114 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:48.505113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.505605 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.506046 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.506936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.517878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.517878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.524516 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 HTTP/1.1 Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:45:48.526074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.527819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'fc571669-74b7-49a8-b7db-1cdfd8b5fa61'} Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:48.528636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.530031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.531383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:48.531383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8d2473bf-30e2-497a-af26-db3f4ebeb321 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 404 len: 111 microversion: 2.1 time: 0.034006 Sep 01 16:45:48.531383 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 602/1223] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:48 2022] DELETE /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:48.536465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:48.537084 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: fc571669-74b7-49a8-b7db-1cdfd8b5fa61] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:48.543032 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.546384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.546384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.546384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:48.546384 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:48.546875 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.562267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 HTTP/1.1 Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:48.563853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.570778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'fc571669-74b7-49a8-b7db-1cdfd8b5fa61'} Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:48.571715 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. Sep 01 16:45:48.573676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:48.575021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance fc571669-74b7-49a8-b7db-1cdfd8b5fa61 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:48.575021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8555ab93-974e-475f-a911-8eecf14ff167 tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61" status: 404 len: 111 microversion: 2.1 time: 0.032655 Sep 01 16:45:48.575021 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 622/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:48 2022] GET /compute/v2.1/servers/fc571669-74b7-49a8-b7db-1cdfd8b5fa61 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:49.049326 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:49.054581 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:49.057809 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.058587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.059141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.060133 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.060663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.061207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.232030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:49.238899 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5d6f0c3b-63bb-45f8-bf2b-12b9dfdfce61 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.193603 Sep 01 16:45:49.239454 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 603/1225] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:49 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:49.841542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:49.843422 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:49.849050 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.849469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.850102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.850842 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.851327 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.851753 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.866558 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: DELETE /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a HTTP/1.1 Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:49.868336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.869994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'dfd400b6-5c1a-4460-9cc0-275782d91b4a'} Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:49.871058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.873446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.875954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:49.875954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-1e489418-0aa6-403b-a906-b8aba662312e tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 404 len: 111 microversion: 2.1 time: 0.031915 Sep 01 16:45:49.875954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 623/1226] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:45:49 2022] DELETE /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:49.880354 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:49.883076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] [instance: dfd400b6-5c1a-4460-9cc0-275782d91b4a] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:49.889928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.889928 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.890388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.891094 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.891588 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.892014 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.912096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] HTTP exception thrown: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Request method failure captured: Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a HTTP/1.1 Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEN7CnGSo2JCEQX4yWIZ3comwkQEdyTsIosghIfpOTVe37swCvseSsmwhL5UP-_oSra4SZQHvyPM5Sau8Whpj9Xig-Mf2Xp0f3apg0ljX58k7qOqZwT--XHELWZxnXIWPIU6UFFOHfogPOPr9inGiycz0fTlLClj9eciMouiD8y4BgAk Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:45:49.915049 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a994270b8e1f43328b827696f9d89bb0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a994270b8e1f43328b827696f9d89bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: a994270b8e1f43328b827696f9d89bb0 Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-386918362 Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: 8a45ee95cf5947c49584ff403facaff7 Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-386918362-project Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.918925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'dfd400b6-5c1a-4460-9cc0-275782d91b4a'} Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:49.920367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. Sep 01 16:45:49.923461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:49.924975 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] Returning 404 to user: Instance dfd400b6-5c1a-4460-9cc0-275782d91b4a could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:49.924975 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c8540e29-01f5-4327-bce3-a66bd31f1f4a tempest-AttachVolumeNegativeTest-386918362 tempest-AttachVolumeNegativeTest-386918362-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a" status: 404 len: 111 microversion: 2.1 time: 0.041591 Sep 01 16:45:49.924975 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 604/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:49 2022] GET /compute/v2.1/servers/dfd400b6-5c1a-4460-9cc0-275782d91b4a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:45:50.272502 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:50.273928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:50.289660 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:50.290615 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:50.292435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:50.300008 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:50.300582 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:50.301118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:50.496697 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:50.509196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-151aba39-4b2e-43e7-9ccd-faa7f5f0c04d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.252606 Sep 01 16:45:50.509993 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 624/1228] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:50 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:51.535598 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:51.536846 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:51.548831 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:51.549752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:51.550461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:51.551765 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:51.552526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:51.553458 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:51.797305 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:51.805108 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d4e4b2e2-2b9e-402c-a822-05e42052321d tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.276651 Sep 01 16:45:51.805934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 605/1229] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:51 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:45:52.834252 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:52.834883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:52.861376 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:52.861876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:52.862315 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:52.863027 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:52.863512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:52.863939 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:53.063572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:53.073329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c802c3d0-de46-4ede-b618-4beb37e7a871 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.250719 Sep 01 16:45:53.074318 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 625/1230] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:52 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:54.101532 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:54.101532 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:54.109641 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:54.110777 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:54.112485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:54.113458 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:54.114076 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:54.114510 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:54.357943 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:54.368942 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-07f15e41-4513-450b-9352-3a94cca732fd tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.278534 Sep 01 16:45:54.370187 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 606/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:54 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:55.038416 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-b1872344-8cda-44fa-8834-9ffcdb90e9f1 req-6b8f7c8f-3dbc-4076-82fd-e3e5c5524a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a4592d-070c-4611-93a5-ee770b7e9ed7", "name": "network-vif-plugged", "status": "completed", "tag": "4d49de64-8086-4086-8c06-bc6923d76693"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:55.047981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-b1872344-8cda-44fa-8834-9ffcdb90e9f1 req-6b8f7c8f-3dbc-4076-82fd-e3e5c5524a86 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.061931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-b1872344-8cda-44fa-8834-9ffcdb90e9f1 req-6b8f7c8f-3dbc-4076-82fd-e3e5c5524a86 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.067192 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-b1872344-8cda-44fa-8834-9ffcdb90e9f1 req-6b8f7c8f-3dbc-4076-82fd-e3e5c5524a86 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.084739 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-b1872344-8cda-44fa-8834-9ffcdb90e9f1 req-6b8f7c8f-3dbc-4076-82fd-e3e5c5524a86 service nova] Creating event network-vif-plugged:4d49de64-8086-4086-8c06-bc6923d76693 for instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 on hv-cinder-83602 Sep 01 16:45:55.095415 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-b1872344-8cda-44fa-8834-9ffcdb90e9f1 req-6b8f7c8f-3dbc-4076-82fd-e3e5c5524a86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066158 Sep 01 16:45:55.096772 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 626/1232] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:55.390340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:55.391181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:55.399809 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.400297 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.400763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.401465 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:55.401921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:55.402468 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:55.589866 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:55.601038 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5d9823bc-4df5-4d7a-b2f9-02b9b1900972 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.214579 Sep 01 16:45:55.608118 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 607/1233] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:55 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:56.623451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:56.624143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:56.626205 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:56.631714 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:56.632207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:56.633329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:56.633486 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:56.633947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:56.634374 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:56.775126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:56.785853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a7640f31-4ba9-4e3e-86ac-a64f10a7a4ab tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1258 microversion: 2.1 time: 0.166949 Sep 01 16:45:56.787059 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 627/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:56 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:57.537463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3e0bf7a4-6e63-4dde-8e05-d5a97734f1f5 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Action: 'create', calling method: .version_select at 0x7fe379f34ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1719812371", "metadata": {"Type": "work"}}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3e0bf7a4-6e63-4dde-8e05-d5a97734f1f5 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Request method failure captured: Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 122 Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEOHFmd7P9Nu31Hyg2beMgJfHNWGzOAIakegLpiStrn_IlnhDzHTqBJgm9tnw0QR4wHJ9lYswO6DJXjVCZu63rvLLGF_svMh6ArFHRqKZX7pK8qaic9VSWi3NkZoIdakLDH1f5B18ShGSlKTnoZSnFkyyeCZiAgy7Q07nKiZNZ1lvt0k Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:45:57.553706 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c58fed2359504c93af3e64367b514912", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: f749da2333cb403e9d1f8f72670e2295 Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1719812371", "metadata": {"Type": "work"}}} Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: Sep 01 16:45:57.555427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1719812371', 'metadata': {'Type': 'work'}}}} Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:57.556438 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:45:57.558125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:45:57.559571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:45:57.559571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.559571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3e0bf7a4-6e63-4dde-8e05-d5a97734f1f5 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:57.559571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3e0bf7a4-6e63-4dde-8e05-d5a97734f1f5 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151087 Sep 01 16:45:57.559571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 608/1235] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 1 16:45:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:45:57.568269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3f865601-4b05-4d60-a4dc-1978d16216cf tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Action: 'create', calling method: .version_select at 0x7fe37a112550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1911858814", "metadata": {"Type": "work"}}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3f865601-4b05-4d60-a4dc-1978d16216cf tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Request method failure captured: Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 120 Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEOHFmd7P9Nu31Hyg2beMgJfHNWGzOAIakegLpiStrn_IlnhDzHTqBJgm9tnw0QR4wHJ9lYswO6DJXjVCZu63rvLLGF_svMh6ArFHRqKZX7pK8qaic9VSWi3NkZoIdakLDH1f5B18ShGSlKTnoZSnFkyyeCZiAgy7Q07nKiZNZ1lvt0k Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:57.572928 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c58fed2359504c93af3e64367b514912", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: f749da2333cb403e9d1f8f72670e2295 Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1911858814", "metadata": {"Type": "work"}}} Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: Sep 01 16:45:57.574604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1911858814', 'metadata': {'Type': 'work'}}}} Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi '0' Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:57.575738 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:45:57.577371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:45:57.579285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:45:57.579285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.579285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3f865601-4b05-4d60-a4dc-1978d16216cf tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:57.579285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3f865601-4b05-4d60-a4dc-1978d16216cf tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011422 Sep 01 16:45:57.579285 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 628/1236] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 1 16:45:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:45:57.592512 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5a48e440-88d2-4537-942e-171272659b34 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Action: 'create', calling method: .version_select at 0x7fe37a1ba700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2081662251", "metadata": {"Type": "work"}}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5a48e440-88d2-4537-942e-171272659b34 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Request method failure captured: Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 119 Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEOHFmd7P9Nu31Hyg2beMgJfHNWGzOAIakegLpiStrn_IlnhDzHTqBJgm9tnw0QR4wHJ9lYswO6DJXjVCZu63rvLLGF_svMh6ArFHRqKZX7pK8qaic9VSWi3NkZoIdakLDH1f5B18ShGSlKTnoZSnFkyyeCZiAgy7Q07nKiZNZ1lvt0k Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:45:57.605688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c58fed2359504c93af3e64367b514912", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: f749da2333cb403e9d1f8f72670e2295 Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2081662251", "metadata": {"Type": "work"}}} Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: Sep 01 16:45:57.608207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2081662251', 'metadata': {'Type': 'work'}}}} Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi '' Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:57.609276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:45:57.610959 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:45:57.612423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:45:57.612423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.612423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5a48e440-88d2-4537-942e-171272659b34 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:57.614579 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5a48e440-88d2-4537-942e-171272659b34 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030122 Sep 01 16:45:57.615275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 609/1237] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 1 16:45:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:45:57.626293 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c8b8c77c-5a95-4041-b6e2-6c939305d095 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Calling method '.version_select at 0x7fe37d85f310>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:57.677429 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-c8b8c77c-5a95-4041-b6e2-6c939305d095 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] HTTP exception thrown: Volume tempest-invalid-11173641 could not be found. Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c8b8c77c-5a95-4041-b6e2-6c939305d095 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Request method failure captured: Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-11173641 HTTP/1.1 Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEOHFmd7P9Nu31Hyg2beMgJfHNWGzOAIakegLpiStrn_IlnhDzHTqBJgm9tnw0QR4wHJ9lYswO6DJXjVCZu63rvLLGF_svMh6ArFHRqKZX7pK8qaic9VSWi3NkZoIdakLDH1f5B18ShGSlKTnoZSnFkyyeCZiAgy7Q07nKiZNZ1lvt0k Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:57.679634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c58fed2359504c93af3e64367b514912", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: f749da2333cb403e9d1f8f72670e2295 Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Volume tempest-invalid-11173641 could not be found. Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'tempest-invalid-11173641'} Sep 01 16:45:57.681267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-11173641 could not be found. (HTTP 404) (Request-ID: req-9bd50a8d-21fd-449e-a3f7-03ac07906e34) Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.682122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:45:57.683927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-11173641 could not be found. Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:57.685224 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-11173641 could not be found. Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-11173641 could not be found. Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c8b8c77c-5a95-4041-b6e2-6c939305d095 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Returning 404 to user: Volume tempest-invalid-11173641 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c8b8c77c-5a95-4041-b6e2-6c939305d095 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-11173641" status: 404 len: 97 microversion: 2.1 time: 0.060605 Sep 01 16:45:57.687019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 629/1238] 10.222.0.16 () {58 vars in 1212 bytes} [Thu Sep 1 16:45:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-11173641 => generated 97 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:45:57.695189 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a5cfee4c-fa7b-4a16-8fa6-b6c645e62852 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005759 Sep 01 16:45:57.695741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 610/1239] 10.222.0.16 () {58 vars in 1140 bytes} [Thu Sep 1 16:45:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 16:45:57.717936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0cd4499d-7069-4783-bf7a-caa9c169f762 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004531 Sep 01 16:45:57.717936 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 630/1240] 10.222.0.16 () {58 vars in 1137 bytes} [Thu Sep 1 16:45:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 16:45:57.723320 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-703a9c6e-5700-47b4-bb74-6e8aa8257de6 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Calling method '.version_select at 0x7fe37a204ee0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:57.754749 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-703a9c6e-5700-47b4-bb74-6e8aa8257de6 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] HTTP exception thrown: Volume 4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377 could not be found. Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-703a9c6e-5700-47b4-bb74-6e8aa8257de6 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Request method failure captured: Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/os-volumes/4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377 HTTP/1.1 Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEOHFmd7P9Nu31Hyg2beMgJfHNWGzOAIakegLpiStrn_IlnhDzHTqBJgm9tnw0QR4wHJ9lYswO6DJXjVCZu63rvLLGF_svMh6ArFHRqKZX7pK8qaic9VSWi3NkZoIdakLDH1f5B18ShGSlKTnoZSnFkyyeCZiAgy7Q07nKiZNZ1lvt0k Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:45:57.758896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c58fed2359504c93af3e64367b514912", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: f749da2333cb403e9d1f8f72670e2295 Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Volume 4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377 could not be found. Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377'} Sep 01 16:45:57.760426 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377 could not be found. (HTTP 404) (Request-ID: req-12e56679-249b-4553-b491-3ec5818193bd) Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.761259 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:45:57.762453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377 could not be found. Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:45:57.764197 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377 could not be found. Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377 could not be found. Sep 01 16:45:57.765974 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.767787 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-703a9c6e-5700-47b4-bb74-6e8aa8257de6 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Returning 404 to user: Volume 4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:57.768652 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-703a9c6e-5700-47b4-bb74-6e8aa8257de6 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377" status: 404 len: 109 microversion: 2.1 time: 0.049419 Sep 01 16:45:57.769305 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 611/1241] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:45:57 2022] DELETE /compute/v2.1/os-volumes/4c3b019a-3a2c-43ad-a8f1-4ae4dcbc5377 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:57.778634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-32549849-4964-4c03-8fd6-f31eb7e53213 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Calling method '.version_select at 0x7fe379fe3d30>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:57.807987 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:57.808610 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:57.810404 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-32549849-4964-4c03-8fd6-f31eb7e53213 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] HTTP exception thrown: Volume 092a5487-5168-4aea-aa1e-d87aaf803d12 could not be found. Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-32549849-4964-4c03-8fd6-f31eb7e53213 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Request method failure captured: Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/os-volumes/092a5487-5168-4aea-aa1e-d87aaf803d12 HTTP/1.1 Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEOHFmd7P9Nu31Hyg2beMgJfHNWGzOAIakegLpiStrn_IlnhDzHTqBJgm9tnw0QR4wHJ9lYswO6DJXjVCZu63rvLLGF_svMh6ArFHRqKZX7pK8qaic9VSWi3NkZoIdakLDH1f5B18ShGSlKTnoZSnFkyyeCZiAgy7Q07nKiZNZ1lvt0k Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:45:57.812595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c58fed2359504c93af3e64367b514912", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c58fed2359504c93af3e64367b514912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c58fed2359504c93af3e64367b514912"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: c58fed2359504c93af3e64367b514912 Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-VolumesNegativeTest-1766027661 Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: f749da2333cb403e9d1f8f72670e2295 Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-VolumesNegativeTest-1766027661-project Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Volume 092a5487-5168-4aea-aa1e-d87aaf803d12 could not be found. Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '092a5487-5168-4aea-aa1e-d87aaf803d12'} Sep 01 16:45:57.814142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 092a5487-5168-4aea-aa1e-d87aaf803d12 could not be found. (HTTP 404) (Request-ID: req-a2eb435e-6b41-4922-8ff5-3d0fd1e1c025) Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.815325 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:45:57.816611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 092a5487-5168-4aea-aa1e-d87aaf803d12 could not be found. Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:45:57.817808 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 092a5487-5168-4aea-aa1e-d87aaf803d12 could not be found. Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 092a5487-5168-4aea-aa1e-d87aaf803d12 could not be found. Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-32549849-4964-4c03-8fd6-f31eb7e53213 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] Returning 404 to user: Volume 092a5487-5168-4aea-aa1e-d87aaf803d12 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-32549849-4964-4c03-8fd6-f31eb7e53213 tempest-VolumesNegativeTest-1766027661 tempest-VolumesNegativeTest-1766027661-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/092a5487-5168-4aea-aa1e-d87aaf803d12" status: 404 len: 109 microversion: 2.1 time: 0.039433 Sep 01 16:45:57.819138 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 631/1242] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 16:45:57 2022] GET /compute/v2.1/os-volumes/092a5487-5168-4aea-aa1e-d87aaf803d12 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:57.820393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:57.820393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:57.820393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:57.820393 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:57.820738 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:57.820738 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:57.963796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:57.975856 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fe47a163-49d6-4bc0-a9b2-c17cc370dbcb tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1441 microversion: 2.1 time: 0.172353 Sep 01 16:45:57.976443 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 612/1243] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:57 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1441 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:45:57.997477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:57.998166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:58.004616 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:58.005923 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:58.005923 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:58.006257 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:58.006644 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:58.007071 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:58.164831 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:58.175090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-187e43f7-2760-43d2-89ad-324e1a8a60d8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1441 microversion: 2.1 time: 0.181927 Sep 01 16:45:58.176204 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 632/1244] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:57 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1441 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:01.113128 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-8145b17e-5387-46e0-89a6-b38dd7c3d674 req-db9f58e9-98ed-4fcc-8fda-b5005ea3c1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a4592d-070c-4611-93a5-ee770b7e9ed7", "tag": "4d49de64-8086-4086-8c06-bc6923d76693"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:01.125599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-8145b17e-5387-46e0-89a6-b38dd7c3d674 req-db9f58e9-98ed-4fcc-8fda-b5005ea3c1f7 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:01.126531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-8145b17e-5387-46e0-89a6-b38dd7c3d674 req-db9f58e9-98ed-4fcc-8fda-b5005ea3c1f7 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:01.137597 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-8145b17e-5387-46e0-89a6-b38dd7c3d674 req-db9f58e9-98ed-4fcc-8fda-b5005ea3c1f7 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:01.146248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-8145b17e-5387-46e0-89a6-b38dd7c3d674 req-db9f58e9-98ed-4fcc-8fda-b5005ea3c1f7 service nova] Creating event network-changed:4d49de64-8086-4086-8c06-bc6923d76693 for instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 on hv-cinder-83602 Sep 01 16:46:01.151945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-8145b17e-5387-46e0-89a6-b38dd7c3d674 req-db9f58e9-98ed-4fcc-8fda-b5005ea3c1f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056185 Sep 01 16:46:01.152803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 613/1245] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:09.631636 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-106096648", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "networks": [{"uuid": "782fca62-4835-47fc-98d3-15f4e49c2725"}]}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:09.646813 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=72 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:09.692269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] validate_networks() for [('782fca62-4835-47fc-98d3-15f4e49c2725', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:46:10.075785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:46:10.077110 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:46:10.077690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:46:10.078103 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:46:10.078516 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:46:10.093953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:10.095324 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:10.096175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:10.097656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:10.098803 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:10.099275 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:10.128953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Getting quotas for project 149dd19b0cf147e7b26ad558b74cf85c. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:46:10.166096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Getting quotas for user a2c7edbbe80e477ca0bfcd3de5fa27e9 and project 149dd19b0cf147e7b26ad558b74cf85c. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:46:10.166096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:46:10.166096 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:46:10.411230 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [8d9c089f-2dc7-4a2d-b107-2142e470a1c4] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 16:46:11.419079 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [8d9c089f-2dc7-4a2d-b107-2142e470a1c4] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52060. Sep 01 16:46:11.423884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-59e8b44b-f363-4de2-ba9f-2a57d0126219 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796753 Sep 01 16:46:11.431490 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 633/1246] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:46:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:46:11.452944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a8b1e696-5ecb-43ea-8c12-0c373527f198 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:11.454429 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a8b1e696-5ecb-43ea-8c12-0c373527f198 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:11.457170 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=23 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:11.458237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=58 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:11.523707 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a8b1e696-5ecb-43ea-8c12-0c373527f198 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:11.532071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a8b1e696-5ecb-43ea-8c12-0c373527f198 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1213 microversion: 2.1 time: 0.094803 Sep 01 16:46:11.533334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 614/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:11 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:12.555357 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4ac9d195-86e2-457d-8672-bb580fe7ffe3 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:12.556005 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4ac9d195-86e2-457d-8672-bb580fe7ffe3 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:12.610725 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4ac9d195-86e2-457d-8672-bb580fe7ffe3 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:12.619129 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4ac9d195-86e2-457d-8672-bb580fe7ffe3 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1213 microversion: 2.1 time: 0.068202 Sep 01 16:46:12.623685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 634/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:12 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:13.640413 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:13.641531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:13.649166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:13.649656 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:13.650094 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:13.650792 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:13.651268 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:13.651695 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:13.726650 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:13.730627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-57017b53-5af2-4334-a6f7-f0d44a457908 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1265 microversion: 2.1 time: 0.094208 Sep 01 16:46:13.731573 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 615/1249] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:13 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:14.753581 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:14.754197 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:14.760759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:14.761116 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:14.761559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:14.764824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:14.764824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:14.764824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:14.963838 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:14.974611 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-274f089c-6d9c-40f3-9b01-b6e509d5af41 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1313 microversion: 2.1 time: 0.224982 Sep 01 16:46:14.975846 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 635/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:14 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:15.804461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-b143c0fa-31c2-40da-b1ae-7686b82f1b41 req-fa6be3b9-238b-43dd-86cd-98e34516d4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3e0941c-f883-4424-9f4c-a8e6eb628781", "tag": "3a1949cb-452f-4698-9270-f199cd14ba0a"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:15.815461 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-b143c0fa-31c2-40da-b1ae-7686b82f1b41 req-fa6be3b9-238b-43dd-86cd-98e34516d4bf service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:15.815938 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-b143c0fa-31c2-40da-b1ae-7686b82f1b41 req-fa6be3b9-238b-43dd-86cd-98e34516d4bf service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:15.816386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-b143c0fa-31c2-40da-b1ae-7686b82f1b41 req-fa6be3b9-238b-43dd-86cd-98e34516d4bf service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:15.827813 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-b143c0fa-31c2-40da-b1ae-7686b82f1b41 req-fa6be3b9-238b-43dd-86cd-98e34516d4bf service nova] Creating event network-changed:3a1949cb-452f-4698-9270-f199cd14ba0a for instance b3e0941c-f883-4424-9f4c-a8e6eb628781 on hv-cinder-83602 Sep 01 16:46:15.834215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-b143c0fa-31c2-40da-b1ae-7686b82f1b41 req-fa6be3b9-238b-43dd-86cd-98e34516d4bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033473 Sep 01 16:46:15.836616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 616/1251] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:46:15.997562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:15.998410 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:16.005802 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:16.006425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:16.006963 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:16.008724 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:16.008724 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:16.009402 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:16.162860 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:16.170945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dc0360d6-b346-4103-9912-04af06395b88 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1313 microversion: 2.1 time: 0.177349 Sep 01 16:46:16.172351 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 636/1252] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:15 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:17.193753 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:17.194881 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:17.202264 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:17.202670 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:17.203109 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:17.203847 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:17.204307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:17.204731 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:17.354006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:17.379954 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-37f575c8-8265-4acb-a2a9-4d47bf2ddbe0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1313 microversion: 2.1 time: 0.190349 Sep 01 16:46:17.391552 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 617/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:17 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:18.405355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:18.406827 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:18.413219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:18.413622 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:18.414037 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:18.414725 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:18.415463 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:18.415906 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:18.582155 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:18.591505 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-206e2935-be1e-4966-88fd-05a1d9af0161 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1313 microversion: 2.1 time: 0.189996 Sep 01 16:46:18.592103 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 637/1254] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:18 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:19.613908 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:19.614519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:19.620951 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:19.621374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:19.621803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:19.622511 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:19.622963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:19.623412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:19.750045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:19.757815 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-139733b4-344b-4371-b009-f53ab766c1cc tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1313 microversion: 2.1 time: 0.148503 Sep 01 16:46:19.758319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 618/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:19 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:20.779190 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:20.779847 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:20.784313 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:20.787880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:20.788365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:20.788790 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:20.789479 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:20.789922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:20.790331 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:20.939250 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:20.947199 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e5645e45-ca94-4327-a034-a1eeebdfc4f2 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1313 microversion: 2.1 time: 0.171785 Sep 01 16:46:20.947797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 638/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:20 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:21.968136 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:21.969090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:21.971773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:21.977310 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:21.977797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:21.978224 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:21.978921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:21.979403 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:21.979847 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:22.136902 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:22.146496 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-05db1627-ba1a-44ce-bec7-c3f586784b33 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1313 microversion: 2.1 time: 0.182941 Sep 01 16:46:22.147084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 619/1257] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:21 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:22.928080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=8 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:22.932290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-c3b718e5-ed66-4ff9-86a8-4fbcb0923a7e req-d14f53e0-800d-47ee-96f5-8d36a143384e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e0941c-f883-4424-9f4c-a8e6eb628781", "name": "network-vif-plugged", "status": "completed", "tag": "3a1949cb-452f-4698-9270-f199cd14ba0a"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:22.948066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-c3b718e5-ed66-4ff9-86a8-4fbcb0923a7e req-d14f53e0-800d-47ee-96f5-8d36a143384e service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:22.948521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-c3b718e5-ed66-4ff9-86a8-4fbcb0923a7e req-d14f53e0-800d-47ee-96f5-8d36a143384e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:22.950129 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-c3b718e5-ed66-4ff9-86a8-4fbcb0923a7e req-d14f53e0-800d-47ee-96f5-8d36a143384e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:22.961802 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-c3b718e5-ed66-4ff9-86a8-4fbcb0923a7e req-d14f53e0-800d-47ee-96f5-8d36a143384e service nova] Creating event network-vif-plugged:3a1949cb-452f-4698-9270-f199cd14ba0a for instance b3e0941c-f883-4424-9f4c-a8e6eb628781 on hv-cinder-83602 Sep 01 16:46:22.967087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-c3b718e5-ed66-4ff9-86a8-4fbcb0923a7e req-d14f53e0-800d-47ee-96f5-8d36a143384e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040287 Sep 01 16:46:22.967763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 639/1258] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:23.169008 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:23.170194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:23.177874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:23.178362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:23.178823 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:23.179556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:23.180009 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:23.180427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:23.329181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:23.338945 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-db6c4ca2-3178-47a9-8aee-00d87b2f4d63 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1313 microversion: 2.1 time: 0.175317 Sep 01 16:46:23.339826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 620/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:23 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:24.365891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:24.365891 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:24.369271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:24.370103 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:24.370876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:24.371606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:24.372057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:24.372478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:24.537261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:24.547954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ff218003-c65f-4cf6-a847-013ea1666514 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1313 microversion: 2.1 time: 0.190779 Sep 01 16:46:24.548547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 640/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:24 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:25.570299 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:25.571095 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:25.578900 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:25.579502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:25.580106 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:25.580804 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:25.581331 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:25.581822 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:25.718707 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:25.726925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-43bc033e-0ad8-4550-a2af-4795aab347d0 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1497 microversion: 2.1 time: 0.160795 Sep 01 16:46:25.727602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 621/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:25 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:26.808491 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:26.808988 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:26.817070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:26.817553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:26.817982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:26.818665 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:26.819119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:26.819593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:26.845216 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:46:27.147011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-9e100e2f-4c4c-431f-afe1-a2e349b291ba tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 204 len: 0 microversion: 2.1 time: 0.341859 Sep 01 16:46:27.148071 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 641/1262] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:46:26 2022] DELETE /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:46:27.158303 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:27.159080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:27.167058 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:27.167860 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:27.168023 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:27.168738 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:27.169345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:27.169814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:27.341618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:27.351574 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d7e55e96-34bd-43fc-a3d1-bbfe6bc57ad1 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1503 microversion: 2.1 time: 0.197097 Sep 01 16:46:27.375725 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 622/1263] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:27 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:28.381525 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:28.382153 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:28.388509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:28.388994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:28.389489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:28.390192 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:28.390641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:28.391177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:28.547983 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:28.556035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-3a784097-46e7-4e40-bd91-d9e779e90b03 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1503 microversion: 2.1 time: 0.178942 Sep 01 16:46:28.562763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 642/1264] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:28 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:29.579927 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:29.580756 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:29.587794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:29.588311 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:29.588930 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:29.589615 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:29.590062 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:29.590482 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:29.615785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-56b6e1e4-3302-477e-ae80-5ca7011064c6 req-d6b041f2-752d-4679-80a0-30d580426601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e0941c-f883-4424-9f4c-a8e6eb628781", "name": "network-vif-deleted", "tag": "3a1949cb-452f-4698-9270-f199cd14ba0a"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:29.629785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-56b6e1e4-3302-477e-ae80-5ca7011064c6 req-d6b041f2-752d-4679-80a0-30d580426601 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:29.632139 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-56b6e1e4-3302-477e-ae80-5ca7011064c6 req-d6b041f2-752d-4679-80a0-30d580426601 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:29.632139 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-56b6e1e4-3302-477e-ae80-5ca7011064c6 req-d6b041f2-752d-4679-80a0-30d580426601 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:29.642630 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-56b6e1e4-3302-477e-ae80-5ca7011064c6 req-d6b041f2-752d-4679-80a0-30d580426601 service nova] Creating event network-vif-deleted:3a1949cb-452f-4698-9270-f199cd14ba0a for instance b3e0941c-f883-4424-9f4c-a8e6eb628781 on hv-cinder-83602 Sep 01 16:46:29.648866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-56b6e1e4-3302-477e-ae80-5ca7011064c6 req-d6b041f2-752d-4679-80a0-30d580426601 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038302 Sep 01 16:46:29.651227 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 643/1265] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:29.666172 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:29.675029 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0ef4e273-adf3-4f39-8d0d-feba442af302 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1461 microversion: 2.1 time: 0.100410 Sep 01 16:46:29.675660 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 623/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:29 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:30.697590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:30.698291 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:30.705679 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:30.706220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:30.706653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:30.707392 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:30.707849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:30.708265 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:30.741627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:30.741805 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:30.742166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:30.742601 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lazy-loading 'fault' on Instance uuid b3e0941c-f883-4424-9f4c-a8e6eb628781 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:46:30.786816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:30.794002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7189f430-e44a-47de-98f7-b62aafaf7177 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 200 len: 1303 microversion: 2.1 time: 0.100619 Sep 01 16:46:30.794573 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 644/1267] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:30 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:31.815953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:31.816685 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: b3e0941c-f883-4424-9f4c-a8e6eb628781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:31.823121 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:31.823633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:31.824078 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:31.824757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:31.825208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:31.825627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:31.839611 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] HTTP exception thrown: Instance b3e0941c-f883-4424-9f4c-a8e6eb628781 could not be found. Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Request method failure captured: Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 HTTP/1.1 Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEOHP0gWYWLkJcBP0Zktv5cqyIW_0OvTKjyKqbPCf_QCmAVcTwbYvm81Fu2DDVVCTTXu9CSrBeYlB5LYxmQZtjD5NpXP5tAgi8-MYIieMnD0JaXgmXhjdGh-dhVDoZMGIYSj9JFX9tiXNutO99M2URx4KttHRB84pnpHGJHyjDPF9qlA Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: 149dd19b0cf147e7b26ad558b74cf85c Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesActionsTest-1508285093 Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:46:31.841177 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_149dd19b0cf147e7b26ad558b74cf85c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/149dd19b0cf147e7b26ad558b74cf85c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/149dd19b0cf147e7b26ad558b74cf85c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/149dd19b0cf147e7b26ad558b74cf85c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesActionsTest-1508285093 Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 149dd19b0cf147e7b26ad558b74cf85c Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesActionsTest-1508285093 Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesActionsTest-1508285093-project Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: a2c7edbbe80e477ca0bfcd3de5fa27e9 Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesActionsTest-1508285093-project Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance b3e0941c-f883-4424-9f4c-a8e6eb628781 could not be found. Sep 01 16:46:31.843948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'b3e0941c-f883-4424-9f4c-a8e6eb628781'} Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3e0941c-f883-4424-9f4c-a8e6eb628781 could not be found. Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:46:31.844916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3e0941c-f883-4424-9f4c-a8e6eb628781 could not be found. Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3e0941c-f883-4424-9f4c-a8e6eb628781 could not be found. Sep 01 16:46:31.846470 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:31.847914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Returning 404 to user: Instance b3e0941c-f883-4424-9f4c-a8e6eb628781 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:46:31.847914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f5c87ec1-2950-4d8e-bd42-dfe01659ed1f tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781" status: 404 len: 111 microversion: 2.1 time: 0.031202 Sep 01 16:46:31.847914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 624/1268] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:31 2022] GET /compute/v2.1/servers/b3e0941c-f883-4424-9f4c-a8e6eb628781 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:46:31.943596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-605881676", "imageRef": "c17e75d5-f0a6-407c-91d0-add076cc29c8", "flavorRef": "452", "networks": [{"uuid": "782fca62-4835-47fc-98d3-15f4e49c2725"}]}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:31.999416 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] validate_networks() for [('782fca62-4835-47fc-98d3-15f4e49c2725', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:46:32.375905 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:46:32.381542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:46:32.381542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:46:32.381542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:46:32.381542 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:46:32.386905 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:32.387430 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:32.387893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:32.388613 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:32.389131 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:32.389659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:32.407409 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Getting quotas for project 149dd19b0cf147e7b26ad558b74cf85c. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:46:32.411596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Getting quotas for user a2c7edbbe80e477ca0bfcd3de5fa27e9 and project 149dd19b0cf147e7b26ad558b74cf85c. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:46:32.424164 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:46:32.426363 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c17e75d5-f0a6-407c-91d0-add076cc29c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:46:32.569890 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-17f42835-cb51-4d6c-91e6-8eab1a7b4a06 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629997 Sep 01 16:46:32.570638 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 645/1269] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:46:32.582258 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1f251f8a-9a62-46ce-bd1a-be02212fc767 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:32.583056 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1f251f8a-9a62-46ce-bd1a-be02212fc767 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:32.642921 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1f251f8a-9a62-46ce-bd1a-be02212fc767 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:32.651556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1f251f8a-9a62-46ce-bd1a-be02212fc767 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1213 microversion: 2.1 time: 0.073359 Sep 01 16:46:32.652141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 625/1270] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:32 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:33.677786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:33.678414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:33.685326 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:33.685769 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:33.686199 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:33.687380 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:33.687824 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:33.688234 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:33.760099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:33.768069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7da716bc-6903-484e-8429-4935f828e9f7 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1217 microversion: 2.1 time: 0.097656 Sep 01 16:46:33.768659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 646/1271] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:33 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:34.789015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:34.789626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:34.797288 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:34.797761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:34.798183 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:34.798906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:34.799564 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:34.799986 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:34.887653 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:34.896873 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4f33f3f9-2c14-4e0a-b893-26c524eca101 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1273 microversion: 2.1 time: 0.111814 Sep 01 16:46:34.897454 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 626/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:34 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:35.919590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:35.920120 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:35.929102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:35.929584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:35.930063 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:35.930782 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:35.931436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:35.932019 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:36.089348 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:36.098473 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-61e19cb5-8a89-4061-a9fc-1a3aca2b7a7e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.182982 Sep 01 16:46:36.099740 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 647/1273] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:35 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:37.107023 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-fa441d1b-7116-4d1f-9869-ee915a542bb1 req-600542b8-4be0-4937-b2a8-8916ae205aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdbb7665-88b2-4b1e-8fcc-f2a3f557e516", "tag": "56d94778-f1dd-4a5f-9d97-4bfb5490aa32"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:37.118560 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fa441d1b-7116-4d1f-9869-ee915a542bb1 req-600542b8-4be0-4937-b2a8-8916ae205aaa service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.119044 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fa441d1b-7116-4d1f-9869-ee915a542bb1 req-600542b8-4be0-4937-b2a8-8916ae205aaa service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.119720 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fa441d1b-7116-4d1f-9869-ee915a542bb1 req-600542b8-4be0-4937-b2a8-8916ae205aaa service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.125607 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:37.126251 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:37.136134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.136633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.137116 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.138002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.138880 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-fa441d1b-7116-4d1f-9869-ee915a542bb1 req-600542b8-4be0-4937-b2a8-8916ae205aaa service nova] Creating event network-changed:56d94778-f1dd-4a5f-9d97-4bfb5490aa32 for instance cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 on hv-cinder-83602 Sep 01 16:46:37.139726 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.140545 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.145258 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-fa441d1b-7116-4d1f-9869-ee915a542bb1 req-600542b8-4be0-4937-b2a8-8916ae205aaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042040 Sep 01 16:46:37.146454 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 627/1274] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:37.289142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:37.307370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-112baab4-8c5e-4f8c-af88-2ca7283e7951 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.188687 Sep 01 16:46:37.311262 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 648/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:37 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:38.330345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:38.331170 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:38.337795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:38.338268 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:38.338693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:38.339576 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:38.340070 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:38.340485 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:38.485346 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:38.494077 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3ca9cc3c-04bc-423f-ba5f-705714b8f74e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.168381 Sep 01 16:46:38.494678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 628/1276] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:38 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:39.515516 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:39.516166 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:39.522635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:39.523126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:39.523620 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:39.524314 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:39.524765 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:39.525181 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:39.663231 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:39.674958 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c85e8da9-376b-4712-b53d-b1745b5be594 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.163421 Sep 01 16:46:39.684690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 649/1277] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:39 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:40.704203 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:40.705056 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:40.712359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:40.712851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:40.713287 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:40.713989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:40.714444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:40.714860 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:40.868444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:40.878897 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5d73c41c-20d8-44d9-85ce-afcefa4d64ca tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.178776 Sep 01 16:46:40.879696 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 629/1278] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:40 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:41.901267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:41.901884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:41.904656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:41.909549 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:41.910033 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:41.910466 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:41.911169 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:41.911638 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:41.912054 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:41.914989 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:42.065124 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:42.073986 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-460c53c0-3c0d-474a-b03d-55c5676ab295 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.176622 Sep 01 16:46:42.074568 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 650/1279] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:41 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:43.096568 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:43.097673 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:43.099709 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:43.100416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=37 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:43.105148 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:43.114963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:43.114963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:43.114963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:43.114963 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:43.115436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:43.115436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=73 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:43.257940 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:43.266819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-27038e08-a6a8-4b85-bb6f-a322fae3c8ac tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.173568 Sep 01 16:46:43.266819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 630/1280] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:43 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:44.289701 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:44.290907 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:44.294319 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:44.298199 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=6 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:44.301396 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:44.301879 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:44.302307 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:44.303001 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:44.303659 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:44.304073 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:44.474072 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:44.482597 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7cbcfdcc-c503-4194-ae40-5e7bad768f11 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.198376 Sep 01 16:46:44.483212 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 651/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:44 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:45.146929 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-69168e78-e311-4f33-82b9-0aa13e76b913 req-509249b0-fa61-480b-a783-fd3887cc3707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdbb7665-88b2-4b1e-8fcc-f2a3f557e516", "name": "network-vif-plugged", "status": "completed", "tag": "56d94778-f1dd-4a5f-9d97-4bfb5490aa32"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:45.169371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-69168e78-e311-4f33-82b9-0aa13e76b913 req-509249b0-fa61-480b-a783-fd3887cc3707 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:45.169371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-69168e78-e311-4f33-82b9-0aa13e76b913 req-509249b0-fa61-480b-a783-fd3887cc3707 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:45.169371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-69168e78-e311-4f33-82b9-0aa13e76b913 req-509249b0-fa61-480b-a783-fd3887cc3707 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:45.186524 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-69168e78-e311-4f33-82b9-0aa13e76b913 req-509249b0-fa61-480b-a783-fd3887cc3707 service nova] Creating event network-vif-plugged:56d94778-f1dd-4a5f-9d97-4bfb5490aa32 for instance cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 on hv-cinder-83602 Sep 01 16:46:45.193653 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-69168e78-e311-4f33-82b9-0aa13e76b913 req-509249b0-fa61-480b-a783-fd3887cc3707 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053830 Sep 01 16:46:45.200966 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 631/1282] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:45.510022 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:45.510641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:45.517992 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:45.518735 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:45.519402 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:45.520118 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:45.520578 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:45.520998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:45.659407 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:45.669643 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6a037dcc-0021-42e5-80b5-719c000de6a4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.162953 Sep 01 16:46:45.688180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 652/1283] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:45 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:46.691944 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:46.693294 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:46.698857 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:46.699361 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:46.699786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:46.700558 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:46.701347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:46.701769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:46.845879 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:46.854345 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a0249aa5-5345-4d9c-a939-66938b78d116 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1313 microversion: 2.1 time: 0.167101 Sep 01 16:46:46.856810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 632/1284] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:46 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:47.882185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:47.884930 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:47.889406 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:47.889895 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:47.890349 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:47.891051 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:47.891537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:47.892048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:48.041820 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:48.059902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cc0c4122-3569-4cc6-b57a-54ab8b3a791a tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1498 microversion: 2.1 time: 0.181071 Sep 01 16:46:48.075324 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 653/1285] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:47 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1498 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:49.690358 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:49.690910 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:49.697605 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:49.698082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:49.698508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:49.699218 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:49.699666 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:49.703104 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:49.731479 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:46:50.048613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ff8791f2-a3f6-4a38-a81c-4ef182954e5e tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 204 len: 0 microversion: 2.1 time: 0.361948 Sep 01 16:46:50.049540 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 633/1286] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:46:49 2022] DELETE /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:46:50.066660 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:50.067935 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:50.074979 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:50.075492 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:50.075925 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:50.076817 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:50.077271 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:50.077689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:50.220279 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:50.228501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-a50d88ab-cab2-4160-9610-b4dbd7b27a08 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1504 microversion: 2.1 time: 0.165704 Sep 01 16:46:50.229076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 654/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:50 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:51.252209 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:51.253215 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:51.266990 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:51.267508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:51.267969 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:51.268874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:51.269387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:51.269802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:51.413229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:51.421955 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-654e977c-a728-4504-a705-bcf018562486 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1504 microversion: 2.1 time: 0.175703 Sep 01 16:46:51.422540 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 634/1288] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:51 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:52.446612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:52.447797 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:52.459135 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:52.459974 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:52.460754 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:52.462037 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:52.462861 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:52.463451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:52.573064 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-a614522b-2d5c-4b2f-8938-0d082e239a14 req-bcb3d9df-e2f2-4d30-b6cc-bae47f276dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdbb7665-88b2-4b1e-8fcc-f2a3f557e516", "name": "network-vif-deleted", "tag": "56d94778-f1dd-4a5f-9d97-4bfb5490aa32"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:52.584037 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a614522b-2d5c-4b2f-8938-0d082e239a14 req-bcb3d9df-e2f2-4d30-b6cc-bae47f276dcd service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:52.585196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a614522b-2d5c-4b2f-8938-0d082e239a14 req-bcb3d9df-e2f2-4d30-b6cc-bae47f276dcd service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:52.585196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a614522b-2d5c-4b2f-8938-0d082e239a14 req-bcb3d9df-e2f2-4d30-b6cc-bae47f276dcd service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:52.589531 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:52.598367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-a614522b-2d5c-4b2f-8938-0d082e239a14 req-bcb3d9df-e2f2-4d30-b6cc-bae47f276dcd service nova] Creating event network-vif-deleted:56d94778-f1dd-4a5f-9d97-4bfb5490aa32 for instance cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 on hv-cinder-83602 Sep 01 16:46:52.609884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c93f936b-6fc7-4334-b77e-1d6234721834 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1462 microversion: 2.1 time: 0.161532 Sep 01 16:46:52.609884 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 655/1289] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:52 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1462 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:52.612206 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-a614522b-2d5c-4b2f-8938-0d082e239a14 req-bcb3d9df-e2f2-4d30-b6cc-bae47f276dcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042675 Sep 01 16:46:52.613062 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 635/1290] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:46:53.626743 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:53.632306 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:53.640267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:53.641011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:53.641446 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:53.642153 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:53.642628 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:53.643045 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:53.678413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:53.678897 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:53.679358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:53.679997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lazy-loading 'fault' on Instance uuid cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:46:53.732501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c7edbbe80e477ca0bfcd3de5fa27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149dd19b0cf147e7b26ad558b74cf85c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:53.740821 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-27c7baeb-62a8-468c-a134-6ca4605f3bf4 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 200 len: 1303 microversion: 2.1 time: 0.120088 Sep 01 16:46:53.741629 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 656/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:53 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:54.764283 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:54.765513 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] [instance: cdbb7665-88b2-4b1e-8fcc-f2a3f557e516] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:54.772780 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:54.773435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:54.779477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:54.779477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:54.779477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:54.779477 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:54.795293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] HTTP exception thrown: Instance cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 could not be found. Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Request method failure captured: Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 HTTP/1.1 Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEOHP0gWYWLkJcBP0Zktv5cqyIW_0OvTKjyKqbPCf_QCmAVcTwbYvm81Fu2DDVVCTTXu9CSrBeYlB5LYxmQZtjD5NpXP5tAgi8-MYIieMnD0JaXgmXhjdGh-dhVDoZMGIYSj9JFX9tiXNutO99M2URx4KttHRB84pnpHGJHyjDPF9qlA Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: 149dd19b0cf147e7b26ad558b74cf85c Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesActionsTest-1508285093 Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:46:54.796996 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_149dd19b0cf147e7b26ad558b74cf85c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/149dd19b0cf147e7b26ad558b74cf85c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/149dd19b0cf147e7b26ad558b74cf85c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/149dd19b0cf147e7b26ad558b74cf85c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesActionsTest-1508285093 Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 149dd19b0cf147e7b26ad558b74cf85c Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesActionsTest-1508285093 Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesActionsTest-1508285093-project Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: a2c7edbbe80e477ca0bfcd3de5fa27e9 Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesActionsTest-1508285093-project Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 could not be found. Sep 01 16:46:54.798584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'cdbb7665-88b2-4b1e-8fcc-f2a3f557e516'} Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 could not be found. Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:46:54.806563 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 could not be found. Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 could not be found. Sep 01 16:46:54.808319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:46:54.809827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] Returning 404 to user: Instance cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:46:54.809827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c25cfc24-108d-4410-a06f-44ff956e4c53 tempest-VolumesActionsTest-1508285093 tempest-VolumesActionsTest-1508285093-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516" status: 404 len: 111 microversion: 2.1 time: 0.039814 Sep 01 16:46:54.809827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 636/1292] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:54 2022] GET /compute/v2.1/servers/cdbb7665-88b2-4b1e-8fcc-f2a3f557e516 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:47:39.286314 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=15 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:39.287060 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=43 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:39.505601 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b81a49b9-e3da-47ac-b6dd-cd463adec3b9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Action: 'create', calling method: .version_select at 0x7fe37a25e9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-306489743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrQLQP7Imz4e96HluUzLI7flOIUN01FNXHc+zWPBnqpBOJ8vPwlN2akemzgFE5gJURp1vZjHL0d2cIbi/RXOYpSq1O4Y/vPUJbF7slJN4TXsSbsJXJHgPccByhy1DCXYw=="}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:39.521544 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-b81a49b9-e3da-47ac-b6dd-cd463adec3b9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Getting quotas for project 38f1672c9b5147fe8fef8659e7953fef. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:47:39.526173 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-b81a49b9-e3da-47ac-b6dd-cd463adec3b9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Getting quotas for user ec2aa8d7d4474e5b802c91c4cb5958cd and project 38f1672c9b5147fe8fef8659e7953fef. Resources: {'key_pairs'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:47:39.645984 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b81a49b9-e3da-47ac-b6dd-cd463adec3b9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.365196 Sep 01 16:47:39.646594 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 657/1293] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 16:47:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:48:07.174504 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:07.175388 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:07.179847 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-792617576", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-306489743", "security_groups": [{"name": "tempest-secgroup-smoke-257194837"}], "block_device_mapping_v2": [{"uuid": "b86bb100-34f2-472c-b171-a8816c8cda97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e53c5cbc-70a6-41bd-bc15-d0d9ee77e1b0"}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:07.302640 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] validate_networks() for [('e53c5cbc-70a6-41bd-bc15-d0d9ee77e1b0', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:48:07.688386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:48:07.688841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:48:07.689315 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:48:07.689794 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:48:07.690337 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:48:07.699448 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:07.699931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:07.700364 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:07.701090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:07.701589 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:07.702009 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:07.720403 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Getting quotas for project 38f1672c9b5147fe8fef8659e7953fef. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:48:07.724329 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Getting quotas for user ec2aa8d7d4474e5b802c91c4cb5958cd and project 38f1672c9b5147fe8fef8659e7953fef. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:48:07.780984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:48:07.783096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b86bb100-34f2-472c-b171-a8816c8cda97',volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:48:08.246493 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0b95b623-9234-44dc-9a72-0c1b5d583d01 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.073505 Sep 01 16:48:08.247879 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 637/1294] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:48:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:48:08.259185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-084578de-5c2a-49dc-bb62-1b27e7588277 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:08.260029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-084578de-5c2a-49dc-bb62-1b27e7588277 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:08.264512 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=4 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:08.265148 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:08.472642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-084578de-5c2a-49dc-bb62-1b27e7588277 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:08.480761 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-084578de-5c2a-49dc-bb62-1b27e7588277 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1093 microversion: 2.1 time: 0.225821 Sep 01 16:48:08.481346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 658/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:08 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1093 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:09.502400 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:09.503676 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:09.511391 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:09.511875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:09.512368 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:09.513060 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:09.513509 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:09.513961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:09.644387 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:09.653764 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-50198c3b-9e03-4d2f-ac31-73c08d39e965 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1143 microversion: 2.1 time: 0.155786 Sep 01 16:48:09.654341 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 638/1296] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:09 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1143 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:10.674903 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:10.675521 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:10.683548 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:10.684030 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:10.684459 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:10.685151 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:10.685590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:10.686008 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:10.750562 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:10.758821 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c08dea6a-19b0-4368-9c58-a5e02afa50c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1191 microversion: 2.1 time: 0.087767 Sep 01 16:48:10.763607 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 659/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:10 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:11.787613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:11.788918 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:11.796026 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:11.803810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:11.803810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:11.803810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:11.803810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:11.804284 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:12.007452 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:12.020273 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4e8f749d-0817-4df2-a6f3-be5e422ab7d8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1276 microversion: 2.1 time: 0.236212 Sep 01 16:48:12.020925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 639/1298] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:11 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1276 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:12.853613 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-9a73e607-d45c-4b32-a194-508f0ea51b2b req-766f6923-9c67-43f0-a47e-3a403480ad14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90c2d5b-e878-487e-a113-7dcdaca36dea", "tag": "c8e1c0c4-09df-4f49-b9cc-2ef5e3814945"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:12.864057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-9a73e607-d45c-4b32-a194-508f0ea51b2b req-766f6923-9c67-43f0-a47e-3a403480ad14 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:12.866332 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-9a73e607-d45c-4b32-a194-508f0ea51b2b req-766f6923-9c67-43f0-a47e-3a403480ad14 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:12.866332 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-9a73e607-d45c-4b32-a194-508f0ea51b2b req-766f6923-9c67-43f0-a47e-3a403480ad14 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:12.877026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-9a73e607-d45c-4b32-a194-508f0ea51b2b req-766f6923-9c67-43f0-a47e-3a403480ad14 service nova] Creating event network-changed:c8e1c0c4-09df-4f49-b9cc-2ef5e3814945 for instance d90c2d5b-e878-487e-a113-7dcdaca36dea on hv-cinder-83602 Sep 01 16:48:12.882253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-9a73e607-d45c-4b32-a194-508f0ea51b2b req-766f6923-9c67-43f0-a47e-3a403480ad14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033138 Sep 01 16:48:12.882855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 660/1299] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:48:13.042330 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:13.042951 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:13.058692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:13.059389 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:13.059830 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:13.060602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:13.061055 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:13.061480 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:13.267311 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:13.275725 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4ef864e3-61b9-41ee-a3ba-97ce6527099a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.237231 Sep 01 16:48:13.276534 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 640/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:13 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:14.298889 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:14.299612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:14.307213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:14.308049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:14.308485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:14.309181 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:14.309631 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:14.310052 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:14.442106 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:14.450039 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c1331c20-319c-48c3-bef1-22c55bd061b3 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.156042 Sep 01 16:48:14.450614 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 661/1301] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:14 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:15.470734 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:15.471386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:15.478522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:15.479127 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:15.479589 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:15.480304 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:15.480754 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:15.481173 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:15.614119 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:15.622759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-00f21d27-e8d1-49c3-a759-839a38804e9d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.156079 Sep 01 16:48:15.623371 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 641/1302] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:15 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:16.643998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:16.644621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:16.651878 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:16.652362 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:16.652793 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:16.653489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:16.653937 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:16.654356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:16.799423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:16.808451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f5560839-77a6-40f7-8190-c519ffd2f7c7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.168396 Sep 01 16:48:16.809059 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 662/1303] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:16 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:17.832602 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:17.833208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:17.835520 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:17.836166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:17.841878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:17.842359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:17.842787 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:17.843562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:17.846825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:17.846825 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:17.991685 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:17.999707 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-405b34db-da47-4aba-84fc-7cfec6f1c24a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.170974 Sep 01 16:48:18.000313 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 642/1304] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:17 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:19.020766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:19.021481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:19.024076 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:19.029515 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:19.030002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:19.030438 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:19.031142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:19.031624 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:19.032045 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:19.172270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:19.180047 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-26a6b7ab-f80b-4ccd-8518-f962169b9eb8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.163158 Sep 01 16:48:19.181123 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 663/1305] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:19 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:20.201950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:20.202543 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:20.209180 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:20.209693 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:20.210124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:20.210816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:20.211293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:20.211767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:20.354299 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:20.362015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a07092f2-b662-4fa4-8d67-60f11c14955d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.163946 Sep 01 16:48:20.362618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 643/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:20 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:21.383454 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:21.384867 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:21.391338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:21.391810 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:21.392263 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:21.392945 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:21.393389 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:21.393864 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:21.536883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:21.544532 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c9b81299-5998-4e9b-b755-f0bd3fa2ccaf tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.165082 Sep 01 16:48:21.545094 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 664/1307] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:21 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:21.635774 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:21.636370 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:21.642694 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:21.643204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:21.643640 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:21.644322 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:21.644772 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:21.645191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:21.668597 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lazy-loading 'flavor' on Instance uuid 49a4592d-070c-4611-93a5-ee770b7e9ed7 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:48:21.988566 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1b2e5b75-98a0-4083-ba68-d0acbd0b8084 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "POST /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7/action" status: 202 len: 0 microversion: 2.1 time: 0.357335 Sep 01 16:48:21.989153 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 644/1308] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:48:21 2022] POST /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:48:21.998157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:21.998779 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:22.004745 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:22.005227 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:22.005658 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:22.006352 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:22.006800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:22.007257 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:22.147253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:22.155531 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-511e001d-c415-4ce9-a409-70f8c9a166c9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.161290 Sep 01 16:48:22.156112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 665/1309] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:21 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:22.565965 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:22.566696 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:22.573359 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:22.573843 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:22.574275 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:22.574966 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:22.575441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:22.575864 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:22.714983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:22.722960 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0ba5a1c7-a0f0-483b-8a75-09b2b0f79f07 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.161397 Sep 01 16:48:22.723599 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 645/1310] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:22 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:23.177200 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:23.177791 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:23.185191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:23.185669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:23.186101 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:23.186788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:23.187258 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:23.187676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:23.329742 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:23.338268 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-45cf58c0-9de6-41ec-bf0b-15a42f4bbaf1 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.164884 Sep 01 16:48:23.338868 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 666/1311] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:23 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:23.744194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:23.744864 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:23.751601 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:23.752081 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:23.752511 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:23.753202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:23.753655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:23.754071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:23.890805 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:23.898469 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-959dff23-6872-4b8c-8911-df6017b632f0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.158420 Sep 01 16:48:23.899750 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 646/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:23 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:24.361954 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:24.362996 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:24.370544 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:24.371029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:24.371756 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:24.372557 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:24.373013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:24.373436 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:24.521057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:24.529204 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4c053ccf-a2c6-41fe-858c-16e2144029c6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.173674 Sep 01 16:48:24.529788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 667/1313] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:24 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:24.919935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:24.920787 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:24.927849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:24.928332 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:24.928762 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:24.929453 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:24.929901 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:24.930952 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:25.077587 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:25.085255 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b75c8e3b-0521-49fd-85ea-39bfa73aaa3f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.169184 Sep 01 16:48:25.085827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 647/1314] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:24 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:25.493833 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-d9ae8db5-489a-4a2b-9071-cf988da7e045 req-3889dfb9-cd41-4c76-b2b2-4130f8968f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90c2d5b-e878-487e-a113-7dcdaca36dea", "name": "network-vif-plugged", "status": "completed", "tag": "c8e1c0c4-09df-4f49-b9cc-2ef5e3814945"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:25.503784 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-d9ae8db5-489a-4a2b-9071-cf988da7e045 req-3889dfb9-cd41-4c76-b2b2-4130f8968f8a service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:25.504261 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-d9ae8db5-489a-4a2b-9071-cf988da7e045 req-3889dfb9-cd41-4c76-b2b2-4130f8968f8a service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:25.504713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-d9ae8db5-489a-4a2b-9071-cf988da7e045 req-3889dfb9-cd41-4c76-b2b2-4130f8968f8a service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:25.515566 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-d9ae8db5-489a-4a2b-9071-cf988da7e045 req-3889dfb9-cd41-4c76-b2b2-4130f8968f8a service nova] Creating event network-vif-plugged:c8e1c0c4-09df-4f49-b9cc-2ef5e3814945 for instance d90c2d5b-e878-487e-a113-7dcdaca36dea on hv-cinder-83602 Sep 01 16:48:25.520621 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-d9ae8db5-489a-4a2b-9071-cf988da7e045 req-3889dfb9-cd41-4c76-b2b2-4130f8968f8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030912 Sep 01 16:48:25.521281 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 668/1315] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:48:25.562419 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:25.563036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:25.569435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:25.569924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:25.570348 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:25.571763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:25.572444 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:25.572887 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:25.710193 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:25.718715 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0e6c5da7-b856-433d-99f9-4c8bf3ec602c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.165374 Sep 01 16:48:25.719312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 648/1316] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:25 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:26.109859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:26.110550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:26.116755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:26.117231 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:26.118195 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:26.119387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:26.119848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:26.120269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:26.267514 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:26.275449 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cbb3abe8-3271-4a68-afec-6b78b104491f tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.169762 Sep 01 16:48:26.276036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 669/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:26 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:26.740799 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:26.741456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:26.748008 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:26.748486 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:26.748917 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:26.749607 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:26.750052 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:26.750467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:26.883073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:26.891877 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3babaf36-76f8-41fa-befc-4dc3497ab19a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.154896 Sep 01 16:48:26.892530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 649/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:26 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:27.296356 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:27.296982 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:27.303598 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:27.304080 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:27.304511 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:27.305255 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:27.305749 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:27.306158 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:27.451623 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:27.460128 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ed9c89d5-fc9b-4ec0-a2c3-369f587f12de tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1264 microversion: 2.1 time: 0.167576 Sep 01 16:48:27.460908 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 670/1319] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:27 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:27.913569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:27.914181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:27.921722 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:27.922323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:27.922703 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:27.923423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:27.927676 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:27.927676 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:28.067170 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:28.075555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d0415a14-6b4b-40a8-9ec3-0d8de2603a0e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.165875 Sep 01 16:48:28.076140 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 650/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:27 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:28.482245 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:28.482812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:28.488647 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:28.489121 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:28.489550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:28.490221 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:28.490660 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:28.491073 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:28.860086 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:28.868401 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ea047c9b-c1b8-4956-b847-338e114c7d19 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1450 microversion: 2.1 time: 0.389666 Sep 01 16:48:28.868969 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 671/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:28 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1450 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:28.888494 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:28.889200 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:28.895302 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:28.895726 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:28.896154 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:28.896885 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:28.897697 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:28.898456 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:29.029615 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:29.037471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-91ba6e47-208c-4d83-b8f4-882485fe0c6d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1450 microversion: 2.1 time: 0.152705 Sep 01 16:48:29.038030 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 651/1322] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:28 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:29.099141 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:29.099794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:29.107445 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:29.107932 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:29.108565 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:29.109269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:29.109728 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:29.110161 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:29.244489 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:29.252506 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-4c15f84b-7a54-4b7e-a1a9-6b23ab4af928 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.157560 Sep 01 16:48:29.253383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 672/1323] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:29 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:30.273829 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:30.274688 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:30.281534 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:30.282110 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:30.282639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:30.283366 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:30.283819 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:30.284237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:30.289912 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:30.480269 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:30.488019 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-36da4838-3144-4032-8769-ce0dffd516bc tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.218238 Sep 01 16:48:30.488581 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 652/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:30 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:31.395140 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-441a9a17-3779-4812-9457-06ee66b05476 req-ad1535c5-f575-4412-bce4-9b51313acd02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90c2d5b-e878-487e-a113-7dcdaca36dea", "tag": "c8e1c0c4-09df-4f49-b9cc-2ef5e3814945"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:31.404855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-441a9a17-3779-4812-9457-06ee66b05476 req-ad1535c5-f575-4412-bce4-9b51313acd02 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:31.405360 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-441a9a17-3779-4812-9457-06ee66b05476 req-ad1535c5-f575-4412-bce4-9b51313acd02 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:31.405755 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-441a9a17-3779-4812-9457-06ee66b05476 req-ad1535c5-f575-4412-bce4-9b51313acd02 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:31.417497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-441a9a17-3779-4812-9457-06ee66b05476 req-ad1535c5-f575-4412-bce4-9b51313acd02 service nova] Creating event network-changed:c8e1c0c4-09df-4f49-b9cc-2ef5e3814945 for instance d90c2d5b-e878-487e-a113-7dcdaca36dea on hv-cinder-83602 Sep 01 16:48:31.422591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-441a9a17-3779-4812-9457-06ee66b05476 req-ad1535c5-f575-4412-bce4-9b51313acd02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031064 Sep 01 16:48:31.427929 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 673/1325] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:48:31.509836 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:31.511332 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:31.517829 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:31.518614 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:31.519046 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:31.519982 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:31.520609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:31.521202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:31.738079 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:31.746692 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-debbd3fc-ecfd-4ed5-a928-c3b189bfb1ce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.241608 Sep 01 16:48:31.755437 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 653/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:31 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:32.769652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:32.770304 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:32.777396 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:32.777883 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:32.778321 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:32.779022 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:32.779510 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:32.779935 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:32.918901 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:32.926752 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7e040744-21ff-4a4b-93d4-32355c6ee21e tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.162012 Sep 01 16:48:32.927362 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 674/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:32 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:33.952343 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:33.953394 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:33.963312 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:33.963796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:33.964239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:33.964924 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:33.965373 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:33.965793 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:34.101152 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:34.109711 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-41793e75-af35-4429-af07-e478232e2b96 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.164655 Sep 01 16:48:34.110270 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 654/1328] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:33 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:35.131573 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:35.132130 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:35.141150 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:35.141866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:35.142470 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:35.144248 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:35.144915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:35.145362 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:35.282463 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:35.291062 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-24dc3b1e-d7fa-42a5-8f42-4b849dcaa62f tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.163759 Sep 01 16:48:35.291674 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 675/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:35 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:36.313149 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:36.313953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:36.321496 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:36.322003 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:36.322435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:36.323192 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:36.323643 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:36.324082 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:36.461237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:36.469970 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-07d78a30-a931-4868-bc2f-d8fa15b93fce tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1567 microversion: 2.1 time: 0.160848 Sep 01 16:48:36.470551 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 655/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:36 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:36.495986 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:36.496604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:36.503049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:36.503495 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:36.503922 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:36.504601 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:36.505047 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:36.505460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:36.534648 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127532) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:48:36.672509 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:36.858610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-56c60ea5-d434-4298-83a9-c5cd20143641 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "POST /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7/action" status: 202 len: 0 microversion: 2.1 time: 0.366950 Sep 01 16:48:36.859583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 676/1331] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 16:48:36 2022] POST /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:48:36.868372 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:36.872300 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:36.875281 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:36.875758 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:36.876188 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:36.877017 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:36.877474 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:36.877889 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:37.014023 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:37.021865 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-81527e72-ec94-43cc-af0f-6123e8ef254a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1515 microversion: 2.1 time: 0.157910 Sep 01 16:48:37.022441 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 656/1332] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:36 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:38.044075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:38.044719 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:38.050827 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:38.051346 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:38.052003 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:38.052721 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:38.053180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:38.053604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:38.205689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:38.213783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-27db2ae4-3a48-48cf-b558-43da8d3bf92b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1515 microversion: 2.1 time: 0.174174 Sep 01 16:48:38.215289 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 677/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:38 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:39.234165 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:39.234736 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:39.237181 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:39.242006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:39.242720 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:39.243279 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:39.244034 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:39.244490 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:39.244914 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:39.386697 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:39.396803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-97448f42-f53f-45af-b862-effd63516ce5 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1517 microversion: 2.1 time: 0.165134 Sep 01 16:48:39.396803 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 657/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:39 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:39.400478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-4d1830dc-b041-4121-a22c-f1cb3ab0e937 req-96ee57c2-d21f-40f3-a7eb-914929a300c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a4592d-070c-4611-93a5-ee770b7e9ed7", "name": "network-vif-unplugged", "status": "completed", "tag": "4d49de64-8086-4086-8c06-bc6923d76693"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:39.406253 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:39.411529 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-4d1830dc-b041-4121-a22c-f1cb3ab0e937 req-96ee57c2-d21f-40f3-a7eb-914929a300c5 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:39.411998 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-4d1830dc-b041-4121-a22c-f1cb3ab0e937 req-96ee57c2-d21f-40f3-a7eb-914929a300c5 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:39.412422 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-4d1830dc-b041-4121-a22c-f1cb3ab0e937 req-96ee57c2-d21f-40f3-a7eb-914929a300c5 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:39.425932 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.compute.server_external_events [req-4d1830dc-b041-4121-a22c-f1cb3ab0e937 req-96ee57c2-d21f-40f3-a7eb-914929a300c5 service nova] Unable to find a host for instance 49a4592d-070c-4611-93a5-ee770b7e9ed7. Dropping event network-vif-unplugged {{(pid=127532) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 16:48:39.426816 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-4d1830dc-b041-4121-a22c-f1cb3ab0e937 req-96ee57c2-d21f-40f3-a7eb-914929a300c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031265 Sep 01 16:48:39.427434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 678/1335] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 01 16:48:40.417323 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:40.417920 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:40.424401 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:40.424880 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:40.425306 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:40.425991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:40.426436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:40.426851 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:40.565941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:40.576984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1ff8ea56-8cdd-4417-8c4b-651a544dc855 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.164279 Sep 01 16:48:40.577576 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 658/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:40 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:41.599668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:41.600280 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:41.607390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:41.607869 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:41.608300 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:41.608984 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:41.609433 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:41.609851 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:41.743177 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:41.753009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8e3891de-a479-430f-847a-16c11b54ea10 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.157593 Sep 01 16:48:41.753595 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 679/1337] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:41 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:42.774556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:42.775166 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:42.781535 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:42.782005 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:42.782427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:42.783111 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:42.783576 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:42.783989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:42.918239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:42.926098 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3fd5f7d9-b33b-4f6c-9c76-52c938820aa9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.155780 Sep 01 16:48:42.926671 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 659/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:42 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:43.950205 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:43.950845 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:43.957293 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:43.957767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:43.958196 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:43.958882 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:43.959361 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:43.959785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:44.091386 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:44.099013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5fbcd866-1123-42c2-9597-814318980734 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.152675 Sep 01 16:48:44.099677 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 680/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:43 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:45.121081 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:45.121757 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:45.128201 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:45.128682 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:45.129145 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:45.129827 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:45.130276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:45.130695 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:45.266472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:45.339481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-98afa797-476e-45bc-a087-07ac4c8ea3d6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.158631 Sep 01 16:48:45.339481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 660/1340] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:45 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:46.297664 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:46.298307 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:46.305608 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:46.306362 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:46.307188 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:46.308146 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:46.308596 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:46.309011 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:46.447684 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:46.455432 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7f52fce2-a959-4ce5-a5cd-c8bea3f4c52b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.161794 Sep 01 16:48:46.456009 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 681/1341] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:46 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:47.477232 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:47.477984 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:47.484460 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:47.484941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:47.485374 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:47.486068 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:47.486522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:47.486941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:47.619991 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:47.627797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c8f8cfef-8ad0-4da2-934e-b51af66c8b43 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.155056 Sep 01 16:48:47.628566 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 661/1342] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:47 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:48.648806 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:48.649414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:48.655763 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:48.656238 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:48.656660 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:48.657336 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:48.657777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:48.658190 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:48.790194 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:48.798292 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-f57470c2-5400-4edb-9f04-9bf5d77a2568 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.153769 Sep 01 16:48:48.798968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 682/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:48 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:49.820471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:49.821276 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:49.827609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:49.828085 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:49.828511 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:49.829188 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:49.829636 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:49.830045 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:49.970950 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:49.979062 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e5718cd8-2c01-40b4-916b-0872a0ac4e68 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.163338 Sep 01 16:48:49.979663 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 662/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:49 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:51.002207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:51.002857 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:51.013383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.018213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.018213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.018213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.018213 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.018641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.171610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:51.180201 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-0792d535-ce4c-4a69-aede-898b405ecc1b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.183408 Sep 01 16:48:51.180766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 683/1345] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:50 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:52.201573 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:52.202224 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:52.208609 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:52.209091 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:52.209525 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:52.210229 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:52.210685 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:52.211108 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:52.347386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:52.356328 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3ffddf09-457f-4f08-845d-69b04f27f389 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.158749 Sep 01 16:48:52.356905 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 663/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:52 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:53.378624 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:53.379361 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:53.386240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:53.386713 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:53.387189 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:53.387899 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:53.388310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:53.388947 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:53.508840 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-eea04774-4dd7-419f-a607-ba2c319d2bc0 req-59df8e62-0467-45bc-b5e3-8927bc9ed6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a4592d-070c-4611-93a5-ee770b7e9ed7", "name": "network-vif-plugged", "status": "completed", "tag": "4d49de64-8086-4086-8c06-bc6923d76693"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:53.520531 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-eea04774-4dd7-419f-a607-ba2c319d2bc0 req-59df8e62-0467-45bc-b5e3-8927bc9ed6e6 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:53.521000 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-eea04774-4dd7-419f-a607-ba2c319d2bc0 req-59df8e62-0467-45bc-b5e3-8927bc9ed6e6 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:53.521421 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-eea04774-4dd7-419f-a607-ba2c319d2bc0 req-59df8e62-0467-45bc-b5e3-8927bc9ed6e6 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:53.580481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:53.580481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-170c73a0-91ff-4eb9-999a-51cd8fe527c8 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.159721 Sep 01 16:48:53.580481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 684/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:53 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:53.580835 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-eea04774-4dd7-419f-a607-ba2c319d2bc0 req-59df8e62-0467-45bc-b5e3-8927bc9ed6e6 service nova] Creating event network-vif-plugged:4d49de64-8086-4086-8c06-bc6923d76693 for instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 on hv-cinder-83602 Sep 01 16:48:53.580835 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-eea04774-4dd7-419f-a607-ba2c319d2bc0 req-59df8e62-0467-45bc-b5e3-8927bc9ed6e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040499 Sep 01 16:48:53.580835 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 664/1348] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:48:54.556157 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:54.557020 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:54.563513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:54.563994 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:54.564425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:54.565143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:54.565593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:54.566016 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:54.699239 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:54.707002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6d2f59fd-dfea-4ed6-bfc7-eb8723624f6b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1573 microversion: 2.1 time: 0.155520 Sep 01 16:48:54.707599 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 685/1349] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:54 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:55.729125 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:55.729818 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:55.736464 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:55.736936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:55.737357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:55.738032 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:55.738471 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:55.738888 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:55.874021 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:55.882228 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3b2ae279-a8ae-4baf-87da-32e71a243082 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1560 microversion: 2.1 time: 0.157694 Sep 01 16:48:55.883114 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 665/1350] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:55 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:50:45.463777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e318b56-7599-44d6-acfe-e194cd1b62d2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 16:50:45.468836 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=15 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:45.468968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7a3da1db-2e6d-4789-a2a5-9f4d7c85d879] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 16:50:45.469390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:45.469390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:50:45.469390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Thu Sep 1 16:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 (ip 10.222.0.16) !!! Sep 01 16:50:45.469390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:50:45.469390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Thu Sep 1 16:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 (ip 10.222.0.16) !!! Sep 01 16:50:45.470022 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=17 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:45.470627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=78 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:50:45.474519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:50:45.474519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Thu Sep 1 16:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 01 16:50:45.474519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:50:45.474519 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Thu Sep 1 16:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 01 16:50:45.479029 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:45.479556 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:45.492399 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:45.494602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:45.494602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:45.494602 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:45.494901 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:45.495383 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:45.527455 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:50:45.564392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-f552bc6c-8186-4166-a6ed-89900c2f87eb req-7926afd2-ad3e-4b38-bd2d-caffaa938c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a4592d-070c-4611-93a5-ee770b7e9ed7", "tag": "4d49de64-8086-4086-8c06-bc6923d76693"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:50:45.576020 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-f552bc6c-8186-4166-a6ed-89900c2f87eb req-7926afd2-ad3e-4b38-bd2d-caffaa938c71 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:45.576502 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-f552bc6c-8186-4166-a6ed-89900c2f87eb req-7926afd2-ad3e-4b38-bd2d-caffaa938c71 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:45.584760 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-f552bc6c-8186-4166-a6ed-89900c2f87eb req-7926afd2-ad3e-4b38-bd2d-caffaa938c71 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:45.588555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-f552bc6c-8186-4166-a6ed-89900c2f87eb req-7926afd2-ad3e-4b38-bd2d-caffaa938c71 service nova] Creating event network-changed:4d49de64-8086-4086-8c06-bc6923d76693 for instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 on hv-cinder-83602 Sep 01 16:50:45.593934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-f552bc6c-8186-4166-a6ed-89900c2f87eb req-7926afd2-ad3e-4b38-bd2d-caffaa938c71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131723 Sep 01 16:50:45.594618 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 666/1351] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:50:45.830520 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b7040c2d-5442-40ca-b8e9-471e1d198f4a tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "DELETE /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 204 len: 0 microversion: 2.1 time: 0.369729 Sep 01 16:50:45.831924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 686/1352] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:50:45 2022] DELETE /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:50:45.841246 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:45.841961 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:45.850644 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:45.851132 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:45.851597 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:45.852310 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:45.852763 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:45.853293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:45.998392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:50:46.006307 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b87df187-51e0-4132-8cb0-bc1a4723ce9b tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.169853 Sep 01 16:50:46.006907 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 667/1353] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:45 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:50:47.028628 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:47.029335 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:47.040593 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:47.041087 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:47.043823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:47.043823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:47.043823 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:47.044232 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:47.047902 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e318b56-7599-44d6-acfe-e194cd1b62d2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54004. Sep 01 16:50:47.185329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:50:47.193292 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-09d6a476-5322-4b41-aa90-fbe161e08de6 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1566 microversion: 2.1 time: 0.169019 Sep 01 16:50:47.193876 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 687/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:47 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:50:48.216433 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:48.217095 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:48.231055 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] [7a3da1db-2e6d-4789-a2a5-9f4d7c85d879] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54010. Sep 01 16:50:48.233931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:48.234418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:48.234849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:48.236340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:48.236340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:48.236639 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:48.504817 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:50:48.514489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a6d0a126-92c2-4fdc-abff-7c07ed7b9941 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1447 microversion: 2.1 time: 0.303772 Sep 01 16:50:48.515108 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 668/1355] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:48 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1447 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:50:48.607270 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-14514034-3490-4f66-88fb-4453a9c4b747 req-65308245-0616-4c29-8be9-05ac2465d08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a4592d-070c-4611-93a5-ee770b7e9ed7", "name": "network-vif-deleted", "tag": "4d49de64-8086-4086-8c06-bc6923d76693"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:50:48.617501 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-14514034-3490-4f66-88fb-4453a9c4b747 req-65308245-0616-4c29-8be9-05ac2465d08d service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:48.618526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-14514034-3490-4f66-88fb-4453a9c4b747 req-65308245-0616-4c29-8be9-05ac2465d08d service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:48.618948 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-14514034-3490-4f66-88fb-4453a9c4b747 req-65308245-0616-4c29-8be9-05ac2465d08d service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:48.630018 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-14514034-3490-4f66-88fb-4453a9c4b747 req-65308245-0616-4c29-8be9-05ac2465d08d service nova] Creating event network-vif-deleted:4d49de64-8086-4086-8c06-bc6923d76693 for instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 on hv-cinder-83602 Sep 01 16:50:48.636468 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-14514034-3490-4f66-88fb-4453a9c4b747 req-65308245-0616-4c29-8be9-05ac2465d08d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033074 Sep 01 16:50:48.637402 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 688/1356] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:50:49.537467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:49.538084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:49.545782 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:49.546270 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:49.546736 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:49.548097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:49.548554 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:49.548981 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:49.621916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edda03844073424d89deff3eafeae7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58b7358110c43ebbfbb5b6de842c94b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:50:49.631013 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6d9e904f-de04-49f3-a045-da3ac9a2d2d9 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 200 len: 1217 microversion: 2.1 time: 0.097872 Sep 01 16:50:49.631860 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 669/1357] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:49 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:50:50.659437 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:50.660140 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] [instance: 49a4592d-070c-4611-93a5-ee770b7e9ed7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:50.666827 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:50.667340 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:50.667777 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:50.668463 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:50.668913 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:50.669358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:50.683290 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] HTTP exception thrown: Instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 could not be found. Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Request method failure captured: Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 HTTP/1.1 Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEOGHJ2G4Osa3FCmEmRgw-XkYDYENSG0DuNOVGA04WmCTxbp9AS9P7kPuQZSUthLCV8NSDtVFjOGi8v4p7NMaoIxo4Qh8XHlCEapCQ5dQ8Eqm7j047-0-HauPe6kDnNzOqg8AM8TXCxt_vTBmrofB1SGeDCACh7AVLO3DreaX9pCYJOM Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: a58b7358110c43ebbfbb5b6de842c94b Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-TestShelveInstance-1173489535 Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:50:50.684900 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a58b7358110c43ebbfbb5b6de842c94b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a58b7358110c43ebbfbb5b6de842c94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a58b7358110c43ebbfbb5b6de842c94b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a58b7358110c43ebbfbb5b6de842c94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-TestShelveInstance-1173489535 Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: a58b7358110c43ebbfbb5b6de842c94b Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-TestShelveInstance-1173489535 Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-TestShelveInstance-1173489535-project Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: edda03844073424d89deff3eafeae7cb Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-TestShelveInstance-1173489535-project Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 could not be found. Sep 01 16:50:50.689859 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': '49a4592d-070c-4611-93a5-ee770b7e9ed7'} Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 could not be found. Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:50:50.690997 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 could not be found. Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 could not be found. Sep 01 16:50:50.693342 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:50:50.694882 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Returning 404 to user: Instance 49a4592d-070c-4611-93a5-ee770b7e9ed7 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:50:50.694882 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-cc630ed5-1350-41ff-b6dc-8256fdfab87c tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7" status: 404 len: 111 microversion: 2.1 time: 0.032203 Sep 01 16:50:50.694882 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 689/1358] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:50 2022] GET /compute/v2.1/servers/49a4592d-070c-4611-93a5-ee770b7e9ed7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:50:50.937947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-97dddbc3-07d3-4106-8b9d-da0bf0ee6a97 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] Calling method '.version_select at 0x7fe37d6fe820>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:51.020314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-97dddbc3-07d3-4106-8b9d-da0bf0ee6a97 tempest-TestShelveInstance-1173489535 tempest-TestShelveInstance-1173489535-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-78941208" status: 202 len: 0 microversion: 2.1 time: 0.086221 Sep 01 16:50:51.020904 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 670/1359] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 16:50:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-78941208 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:51:09.789979 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:09.790572 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:09.793088 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:09.793739 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:09.798526 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:09.804848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:09.804848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:09.804848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:09.804848 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:09.805258 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:09.829175 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:51:10.158456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-dacd79b2-31e0-4481-af82-d3d28a6d309c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 204 len: 0 microversion: 2.1 time: 0.372231 Sep 01 16:51:10.159061 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 690/1360] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:51:09 2022] DELETE /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:51:10.167837 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:10.168449 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:10.170872 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=20 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:10.171526 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:10.177056 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:10.177505 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:10.177935 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:10.180616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:10.180616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:10.180616 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:10.329498 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:10.337626 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b63527b7-33fd-4771-9d7c-1a9184f47571 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1575 microversion: 2.1 time: 0.174134 Sep 01 16:51:10.338773 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 671/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:10 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:11.362747 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:11.363707 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:11.371435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:11.371924 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:11.372358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:11.373057 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:11.373508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:11.373931 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:11.519707 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:11.527877 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-acf74d14-fb8a-4656-8545-a017d131aa93 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1575 microversion: 2.1 time: 0.169365 Sep 01 16:51:11.528456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 691/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:11 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:12.550239 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:12.550868 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:12.558457 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:12.558946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:12.559410 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:12.560120 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:12.560572 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:12.560994 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:12.731237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:12.741677 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7c452b90-0fb7-447d-bd2e-48192b881a34 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1575 microversion: 2.1 time: 0.195702 Sep 01 16:51:12.742472 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 672/1363] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:12 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:13.327799 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-28066f04-58a0-4f2a-889e-5d7f3b14744b req-8118b390-0d9e-4844-b82a-7a2f2b933638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90c2d5b-e878-487e-a113-7dcdaca36dea", "name": "network-vif-deleted", "tag": "c8e1c0c4-09df-4f49-b9cc-2ef5e3814945"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:13.338984 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-28066f04-58a0-4f2a-889e-5d7f3b14744b req-8118b390-0d9e-4844-b82a-7a2f2b933638 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:13.339425 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-28066f04-58a0-4f2a-889e-5d7f3b14744b req-8118b390-0d9e-4844-b82a-7a2f2b933638 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:13.339845 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-28066f04-58a0-4f2a-889e-5d7f3b14744b req-8118b390-0d9e-4844-b82a-7a2f2b933638 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:13.351534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-28066f04-58a0-4f2a-889e-5d7f3b14744b req-8118b390-0d9e-4844-b82a-7a2f2b933638 service nova] Creating event network-vif-deleted:c8e1c0c4-09df-4f49-b9cc-2ef5e3814945 for instance d90c2d5b-e878-487e-a113-7dcdaca36dea on hv-cinder-83602 Sep 01 16:51:13.357742 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-28066f04-58a0-4f2a-889e-5d7f3b14744b req-8118b390-0d9e-4844-b82a-7a2f2b933638 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036462 Sep 01 16:51:13.367035 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 692/1364] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:51:13.764672 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:13.765385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:13.772375 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:13.772864 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:13.773301 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:13.774097 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:13.774557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:13.774985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:13.845384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:13.853976 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6effc676-27a4-483a-8742-e2f74cae5380 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 200 len: 1224 microversion: 2.1 time: 0.094408 Sep 01 16:51:13.854802 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 673/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:13 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:14.876204 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:14.877048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:14.887776 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:14.888297 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:14.888728 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:14.889768 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:14.890068 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:14.890495 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:14.904667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] HTTP exception thrown: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Request method failure captured: Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea HTTP/1.1 Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEOIkNa_UJ-shqJgdO_mhVfVL2mMtYWkXWMFe5z8L15bpBW4l9t8QgT--Sai96g8Imv85MEDk_yoguW2c0vsGAhRA3PRerSvRvEHoAwN1SjigwRQ_cwnxMwoUgKdgA38mg6-zKQoE1G2s2E-GcTub1i2Hnd6Kte-kkV_xyVteM034Oqo Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:51:14.906408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38f1672c9b5147fe8fef8659e7953fef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: ec2aa8d7d4474e5b802c91c4cb5958cd Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:51:14.908191 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'd90c2d5b-e878-487e-a113-7dcdaca36dea'} Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:51:14.909358 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:51:14.911004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:51:14.912508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Returning 404 to user: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:51:14.912508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fcb32995-6366-423c-b160-c09cfcd0e728 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 404 len: 111 microversion: 2.1 time: 0.036430 Sep 01 16:51:14.912508 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 693/1366] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:14 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:51:15.033890 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1546293653", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-306489743", "security_groups": [{"name": "tempest-secgroup-smoke-257194837"}], "block_device_mapping_v2": [{"uuid": "b86bb100-34f2-472c-b171-a8816c8cda97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e53c5cbc-70a6-41bd-bc15-d0d9ee77e1b0"}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:15.159036 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] validate_networks() for [('e53c5cbc-70a6-41bd-bc15-d0d9ee77e1b0', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:51:15.667014 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:51:15.667483 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:51:15.667983 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:51:15.668392 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:51:15.668797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:51:15.678689 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:15.679198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:15.679627 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:15.680600 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:15.681046 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:15.681981 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:15.700786 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Getting quotas for project 38f1672c9b5147fe8fef8659e7953fef. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:51:15.704683 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Getting quotas for user ec2aa8d7d4474e5b802c91c4cb5958cd and project 38f1672c9b5147fe8fef8659e7953fef. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:51:15.764217 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:51:15.766427 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b86bb100-34f2-472c-b171-a8816c8cda97',volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:51:16.180226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aa6cc39f-c853-4187-bc84-097bd9b4772e tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.150155 Sep 01 16:51:16.181193 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 674/1367] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:51:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:51:16.191916 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e2255cb9-8d2f-4534-8f73-d428e8d80357 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:16.192563 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e2255cb9-8d2f-4534-8f73-d428e8d80357 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:16.251785 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e2255cb9-8d2f-4534-8f73-d428e8d80357 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:16.259185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e2255cb9-8d2f-4534-8f73-d428e8d80357 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1094 microversion: 2.1 time: 0.071018 Sep 01 16:51:16.260531 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 694/1368] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:16 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:17.280301 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:17.281071 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:17.291301 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:17.292995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:17.292995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:17.292995 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:17.293376 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:17.294187 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:17.359403 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:17.367257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b70c7d58-01a1-498e-b2d8-7eb2193e94ff tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1144 microversion: 2.1 time: 0.091285 Sep 01 16:51:17.367837 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 675/1369] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:17 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:18.389134 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:18.389698 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:18.397017 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:18.397604 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:18.398180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:18.398728 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:18.399612 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:18.400039 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:18.468049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:18.476094 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7521e1f1-e659-4fbe-9e0c-148ad213f5ba tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1192 microversion: 2.1 time: 0.091608 Sep 01 16:51:18.476672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 695/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:18 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:19.498057 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:19.499296 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:19.517883 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:19.518375 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:19.518814 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:19.519545 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:19.520001 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:19.520421 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:19.721796 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:19.732936 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d91c2dff-c2e8-4e15-af1b-729f166c6ec7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1277 microversion: 2.1 time: 0.238918 Sep 01 16:51:19.742028 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 676/1371] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:19 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:20.425034 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-1ed612b4-11bd-4ec6-9ee6-f7afca8d0482 req-fcb98725-6640-45c0-b35a-30a263ec503b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a2def2-f049-4737-9e7e-53a62ac71fe7", "tag": "1cbdb3ea-9cba-44b9-a5a5-1633d5881c69"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:20.442634 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-1ed612b4-11bd-4ec6-9ee6-f7afca8d0482 req-fcb98725-6640-45c0-b35a-30a263ec503b service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:20.443513 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-1ed612b4-11bd-4ec6-9ee6-f7afca8d0482 req-fcb98725-6640-45c0-b35a-30a263ec503b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:20.444260 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-1ed612b4-11bd-4ec6-9ee6-f7afca8d0482 req-fcb98725-6640-45c0-b35a-30a263ec503b service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:20.460478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-1ed612b4-11bd-4ec6-9ee6-f7afca8d0482 req-fcb98725-6640-45c0-b35a-30a263ec503b service nova] Creating event network-changed:1cbdb3ea-9cba-44b9-a5a5-1633d5881c69 for instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 on hv-cinder-83602 Sep 01 16:51:20.467337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-1ed612b4-11bd-4ec6-9ee6-f7afca8d0482 req-fcb98725-6640-45c0-b35a-30a263ec503b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047081 Sep 01 16:51:20.467337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 696/1372] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:51:20.754223 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:20.754852 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:20.766569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:20.767103 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:20.767539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:20.769139 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:20.770674 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:20.771108 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:20.948199 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:20.956319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb800b9b-4040-4317-830d-2cf529561e76 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.206206 Sep 01 16:51:20.956909 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 677/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:20 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:21.978408 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:21.979527 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:21.985737 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:21.986212 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:21.986641 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:21.987365 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:21.987812 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:21.988269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:22.123704 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:22.131639 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-00770d76-3532-43e0-b8d5-7e8a867418e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.157838 Sep 01 16:51:22.132212 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 697/1374] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:21 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:23.153515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:23.154208 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:23.160962 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:23.161440 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:23.161875 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:23.162571 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:23.163021 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:23.163475 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:23.307360 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:23.315135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c0bb7028-656e-40f2-81ca-69889c25bc54 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.165802 Sep 01 16:51:23.318090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 678/1375] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:23 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:24.337333 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:24.337969 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:24.345020 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:24.345496 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:24.345921 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:24.346606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:24.347048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:24.347487 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:24.486001 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:24.497855 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e7d8b11d-c35a-40cc-90c1-e5e2d5f74d02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.164209 Sep 01 16:51:24.499041 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 698/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:24 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:25.520562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:25.521319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:25.529257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:25.529739 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:25.530164 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:25.530863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:25.531347 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:25.531767 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:25.689381 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:25.700939 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:25.709362 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-26eef19e-1c3a-4ea2-861f-f1173c6671dc tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.193813 Sep 01 16:51:25.710158 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 679/1377] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:25 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:26.734407 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:26.735179 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:26.737581 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:26.742590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:26.743075 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:26.743523 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:26.744244 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:26.744695 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:26.745292 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:26.904566 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:26.912547 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-77698aa2-5f00-4171-ad46-2a02142fb7fb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.182985 Sep 01 16:51:26.913180 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 699/1378] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:26 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:27.935556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:27.936136 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:27.939337 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:27.943650 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:27.944135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:27.944562 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:27.945253 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:27.945878 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:27.946217 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:28.083686 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:28.093613 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c78d1825-0b4f-4cb8-abaa-906b5f05f01a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.163747 Sep 01 16:51:28.094179 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 680/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:27 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:29.115305 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:29.115915 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:29.122481 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:29.126632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:29.126632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:29.126632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:29.126632 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:29.127082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:29.269550 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:29.278507 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7a548926-db6b-4b22-8ecc-fa1fc400051b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.166984 Sep 01 16:51:29.279186 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 700/1380] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:29 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:30.301978 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:30.302575 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:30.309681 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:30.310165 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:30.310593 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:30.311334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:30.311787 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:30.312204 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:30.462849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:30.471754 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8c2a210b-8eaf-4cae-8169-a34d52a090ca tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.173545 Sep 01 16:51:30.473171 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 681/1381] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:30 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:31.493880 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:31.495480 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:31.502478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:31.502893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:31.503370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:31.504121 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:31.504559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:31.509953 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:31.650497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:31.658751 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-26ff84a2-dcbd-4907-9352-f6dd61a6fe30 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.168390 Sep 01 16:51:31.659036 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 701/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:31 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:32.629887 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-a14ef37a-e450-4a5b-b2df-7804bcbfa8f4 req-6d6ca628-3670-4552-b323-360762d23fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a2def2-f049-4737-9e7e-53a62ac71fe7", "name": "network-vif-plugged", "status": "completed", "tag": "1cbdb3ea-9cba-44b9-a5a5-1633d5881c69"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:32.640721 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a14ef37a-e450-4a5b-b2df-7804bcbfa8f4 req-6d6ca628-3670-4552-b323-360762d23fbe service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:32.641202 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a14ef37a-e450-4a5b-b2df-7804bcbfa8f4 req-6d6ca628-3670-4552-b323-360762d23fbe service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:32.641628 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-a14ef37a-e450-4a5b-b2df-7804bcbfa8f4 req-6d6ca628-3670-4552-b323-360762d23fbe service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:32.653915 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-a14ef37a-e450-4a5b-b2df-7804bcbfa8f4 req-6d6ca628-3670-4552-b323-360762d23fbe service nova] Creating event network-vif-plugged:1cbdb3ea-9cba-44b9-a5a5-1633d5881c69 for instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 on hv-cinder-83602 Sep 01 16:51:32.659379 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-a14ef37a-e450-4a5b-b2df-7804bcbfa8f4 req-6d6ca628-3670-4552-b323-360762d23fbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209209 Sep 01 16:51:32.659985 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 682/1383] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:51:32.680219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:32.681083 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:32.688298 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:32.688775 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:32.689203 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:32.689892 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:32.690338 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:32.690759 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:32.824220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:32.832282 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-2696db84-7922-43d6-8642-d57d587e2afb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.155893 Sep 01 16:51:32.834229 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 702/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:32 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:33.855015 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:33.855741 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:33.862357 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:33.862826 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:33.863294 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:33.863971 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:33.864418 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:33.864830 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:34.000073 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:34.007880 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4c669a17-a2db-4e20-94aa-eedded0256b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.157598 Sep 01 16:51:34.008455 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 683/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:33 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:35.031556 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:35.032220 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:35.038709 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:35.039219 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:35.039654 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:35.040350 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:35.040799 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:35.041221 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:35.183918 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:35.192058 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-bf5becda-943c-44ea-ab6a-ac5830d4b9c4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1265 microversion: 2.1 time: 0.164436 Sep 01 16:51:35.192693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 703/1386] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:35 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:36.215014 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:36.215729 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:36.222282 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:36.222774 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:36.223237 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:36.223937 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:36.224455 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:36.224882 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:36.365654 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:36.374384 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-51f4d4e9-6e3f-4a6a-b52b-1b5f436f0a48 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1452 microversion: 2.1 time: 0.164189 Sep 01 16:51:36.374968 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 684/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:36 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:36.396492 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:36.397099 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:36.403642 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:36.404126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:36.404553 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:36.405240 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:36.405685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:36.406100 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:36.546102 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:36.553950 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-28881f65-b4f6-43cb-9c43-3d4f05ecc5a9 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1452 microversion: 2.1 time: 0.161288 Sep 01 16:51:36.554523 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 704/1388] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:36 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:38.579631 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-becb6093-db4c-4c34-b230-fa65a1fbfba7 req-1eaa7dba-57b0-4cca-a2b0-c875f40b9071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a2def2-f049-4737-9e7e-53a62ac71fe7", "tag": "1cbdb3ea-9cba-44b9-a5a5-1633d5881c69"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:38.589855 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-becb6093-db4c-4c34-b230-fa65a1fbfba7 req-1eaa7dba-57b0-4cca-a2b0-c875f40b9071 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:38.590353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-becb6093-db4c-4c34-b230-fa65a1fbfba7 req-1eaa7dba-57b0-4cca-a2b0-c875f40b9071 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:38.590778 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-becb6093-db4c-4c34-b230-fa65a1fbfba7 req-1eaa7dba-57b0-4cca-a2b0-c875f40b9071 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:38.605417 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-becb6093-db4c-4c34-b230-fa65a1fbfba7 req-1eaa7dba-57b0-4cca-a2b0-c875f40b9071 service nova] Creating event network-changed:1cbdb3ea-9cba-44b9-a5a5-1633d5881c69 for instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 on hv-cinder-83602 Sep 01 16:51:38.610480 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-becb6093-db4c-4c34-b230-fa65a1fbfba7 req-1eaa7dba-57b0-4cca-a2b0-c875f40b9071 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093368 Sep 01 16:51:38.611090 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 685/1389] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:53:56.079818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e318b56-7599-44d6-acfe-e194cd1b62d2] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 16:53:56.080414 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:56.081162 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:56.081968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:53:56.082115 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Thu Sep 1 16:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 01 16:53:56.084231 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:53:56.084393 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Thu Sep 1 16:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 01 16:53:56.085825 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:53:56.085944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Thu Sep 1 16:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 01 16:53:56.091303 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2008884778", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-306489743", "security_groups": [{"name": "tempest-secgroup-smoke-257194837"}], "block_device_mapping_v2": [{"uuid": "9f2d7394-ae7b-42b1-8c5a-422864a183bf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e53c5cbc-70a6-41bd-bc15-d0d9ee77e1b0"}]}} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:53:56.285894 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.network.neutron [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] validate_networks() for [('e53c5cbc-70a6-41bd-bc15-d0d9ee77e1b0', None, None, None, None, None)] {{(pid=127532) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:53:56.748901 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Flavor limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:53:56.749316 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Image limits 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:53:56.749794 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Flavor pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:53:56.750202 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Image pref 0:0:0 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:53:56.750696 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.virt.hardware [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:53:56.760357 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:56.760834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:56.761295 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:56.762014 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:56.762460 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:56.762879 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:56.780511 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Getting quotas for project 38f1672c9b5147fe8fef8659e7953fef. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:53:56.784591 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.quota [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Getting quotas for user ec2aa8d7d4474e5b802c91c4cb5958cd and project 38f1672c9b5147fe8fef8659e7953fef. Resources: {'cores', 'instances', 'ram'} {{(pid=127532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:53:56.846225 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Going to run 1 instances... {{(pid=127532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:53:56.848484 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f2d7394-ae7b-42b1-8c5a-422864a183bf',volume_size=None,volume_type=None)] {{(pid=127532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:53:57.088002 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e318b56-7599-44d6-acfe-e194cd1b62d2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54272. Sep 01 16:53:57.341026 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-c43ad41a-0e43-44dd-abc3-0846db49f338 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.263082 Sep 01 16:53:57.341590 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 705/1390] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 16:53:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:53:57.350665 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7a3da1db-2e6d-4789-a2a5-9f4d7c85d879] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 16:53:57.351274 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:57.352031 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=78 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:57.352947 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:53:57.353074 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Thu Sep 1 16:53:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 (ip 10.222.0.16) !!! Sep 01 16:53:57.354198 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:53:57.354338 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Thu Sep 1 16:53:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 (ip 10.222.0.16) !!! Sep 01 16:53:57.355409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:53:57.355591 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Thu Sep 1 16:53:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 (ip 10.222.0.16) !!! Sep 01 16:53:57.361483 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4d2f5b1a-d03a-4647-a1bd-a6a8508e43e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:57.362195 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4d2f5b1a-d03a-4647-a1bd-a6a8508e43e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:57.482252 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4d2f5b1a-d03a-4647-a1bd-a6a8508e43e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:57.490684 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4d2f5b1a-d03a-4647-a1bd-a6a8508e43e8 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1094 microversion: 2.1 time: 0.141959 Sep 01 16:53:57.491423 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 686/1391] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:57 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1094 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:58.513683 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:58.514310 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:58.521014 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:58.523849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:58.523849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:58.523849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:58.523849 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:58.524300 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:58.590614 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:58.598355 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ad3045b1-bc28-454c-9031-766d7fad364b tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1144 microversion: 2.1 time: 0.090703 Sep 01 16:53:58.599184 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 706/1392] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:58 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:59.619354 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:59.619998 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:59.628023 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:59.628508 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:59.628973 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:59.629916 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:59.630421 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:59.630795 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:59.637043 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] [7a3da1db-2e6d-4789-a2a5-9f4d7c85d879] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54298. Sep 01 16:53:59.703308 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:59.711361 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a1a2b944-9360-4538-8fd4-b50a26d31556 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1200 microversion: 2.1 time: 0.096060 Sep 01 16:53:59.711953 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 687/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:59 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1200 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:00.733638 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:00.734257 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:00.742335 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:00.742832 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:00.743296 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:00.744046 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:00.744503 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:00.744973 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:00.897451 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:00.907391 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-705b4973-6d16-4cbd-a79b-836b8b5806db tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1277 microversion: 2.1 time: 0.177681 Sep 01 16:54:00.907995 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 707/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:00 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:01.652443 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-75a67b83-78f6-4cb6-a63a-eb202f6e3c0e req-eba36c31-b71d-4c97-9596-83765015abb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3a781b-0f93-4d38-baa2-fc8ba8989f87", "tag": "3107aaf2-29b9-4f69-8d3e-44b9f94253a5"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:54:01.662926 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-75a67b83-78f6-4cb6-a63a-eb202f6e3c0e req-eba36c31-b71d-4c97-9596-83765015abb8 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:01.663515 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-75a67b83-78f6-4cb6-a63a-eb202f6e3c0e req-eba36c31-b71d-4c97-9596-83765015abb8 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:01.663946 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-75a67b83-78f6-4cb6-a63a-eb202f6e3c0e req-eba36c31-b71d-4c97-9596-83765015abb8 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:01.677182 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-75a67b83-78f6-4cb6-a63a-eb202f6e3c0e req-eba36c31-b71d-4c97-9596-83765015abb8 service nova] Creating event network-changed:3107aaf2-29b9-4f69-8d3e-44b9f94253a5 for instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 on hv-cinder-83602 Sep 01 16:54:01.684569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-75a67b83-78f6-4cb6-a63a-eb202f6e3c0e req-eba36c31-b71d-4c97-9596-83765015abb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035559 Sep 01 16:54:01.685196 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 688/1395] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:54:01.930737 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:01.931390 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:01.938329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:01.938817 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:01.939278 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:01.939985 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:01.940423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:01.940844 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:02.084677 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:02.092635 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-85ab8be1-3b00-4999-a451-fc5191bf5e23 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.166497 Sep 01 16:54:02.093223 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 708/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:01 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:03.115884 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:03.116580 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:03.122799 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:03.123330 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:03.123761 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:03.124481 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:03.124933 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:03.125354 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:03.261824 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:03.270299 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7d637777-13c7-43bd-b538-6f373ba36336 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.159445 Sep 01 16:54:03.271367 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 689/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:03 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:54:04.294326 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:04.295214 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:04.302810 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:04.303680 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:04.304534 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:04.305676 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:04.306500 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:04.307367 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:04.450286 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:04.459070 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-5b328f17-701d-4472-8726-554d1114af4d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.170154 Sep 01 16:54:04.459699 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 709/1398] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:04 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:05.480840 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:05.481442 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:05.488052 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:05.489120 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:05.489678 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:05.490385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:05.490841 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:05.491299 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:05.630111 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:05.638006 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-84f0dbfa-51f1-42fa-ac37-881dd5a85870 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.161473 Sep 01 16:54:05.638580 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 690/1399] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:05 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:06.658969 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:06.659633 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:06.666771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:06.667269 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:06.667695 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:06.668370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:06.668811 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:06.669329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:06.770478 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=2 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:54:06.791185 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell0:SELECT=6 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:54:06.799748 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:06.808435 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-62018932-d1b5-4f06-9c29-f9f1287984eb tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.153337 Sep 01 16:54:06.809000 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 710/1400] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:06 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:07.829273 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:07.829844 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:07.832314 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:54:07.837183 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:07.837669 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:07.838109 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:07.838810 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:07.839293 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:07.839716 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:07.974811 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:07.982564 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a37cb15c-b0c2-4ed4-88d9-9e2d3e8e8909 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.157327 Sep 01 16:54:07.983167 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 691/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:07 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:09.004684 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:09.005347 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:09.012207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:09.012685 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:09.013116 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:09.013809 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:09.014257 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:09.014677 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:09.146656 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:09.156073 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-fd74c0d1-4dcb-4690-9c11-f6420a7a3459 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.155971 Sep 01 16:54:09.156668 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 711/1402] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:08 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:10.176822 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:10.177522 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:10.184302 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:10.184779 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:10.185207 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:10.186012 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:10.186334 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:10.186746 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:10.327439 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:10.336080 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-06fdbe6a-34a6-4c0f-bcb1-7f72fb7582c2 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.163496 Sep 01 16:54:10.336790 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 692/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:10 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:11.359081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:11.359081 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:11.364371 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:11.364850 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:11.365283 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:11.365977 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:11.366423 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:11.366843 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:11.514809 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:11.522853 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-420789fc-42dd-4ab1-a381-5f4e9bf9e063 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.169850 Sep 01 16:54:11.523535 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 712/1404] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:11 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:12.543190 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:12.543781 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:12.550135 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:12.550611 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:12.551141 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:12.551848 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:12.552302 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:12.552723 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:12.682377 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:12.690286 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8a33b482-6efc-482f-85cf-71cd57fddc61 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.151250 Sep 01 16:54:12.690858 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 693/1405] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:12 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:13.410014 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-60ecd61f-d7df-4176-8fc2-4194a5bed608 req-a13ddcfa-f9ad-4e79-b8cf-ca7c91f4dadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3a781b-0f93-4d38-baa2-fc8ba8989f87", "name": "network-vif-plugged", "status": "completed", "tag": "3107aaf2-29b9-4f69-8d3e-44b9f94253a5"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:54:13.421856 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-60ecd61f-d7df-4176-8fc2-4194a5bed608 req-a13ddcfa-f9ad-4e79-b8cf-ca7c91f4dadd service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:13.422332 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-60ecd61f-d7df-4176-8fc2-4194a5bed608 req-a13ddcfa-f9ad-4e79-b8cf-ca7c91f4dadd service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:13.422758 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-60ecd61f-d7df-4176-8fc2-4194a5bed608 req-a13ddcfa-f9ad-4e79-b8cf-ca7c91f4dadd service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:13.435016 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-60ecd61f-d7df-4176-8fc2-4194a5bed608 req-a13ddcfa-f9ad-4e79-b8cf-ca7c91f4dadd service nova] Creating event network-vif-plugged:3107aaf2-29b9-4f69-8d3e-44b9f94253a5 for instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 on hv-cinder-83602 Sep 01 16:54:13.441142 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-60ecd61f-d7df-4176-8fc2-4194a5bed608 req-a13ddcfa-f9ad-4e79-b8cf-ca7c91f4dadd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035284 Sep 01 16:54:13.442207 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 713/1406] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:54:13.712569 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:13.713124 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:13.719734 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:13.720221 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:13.720655 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:13.721378 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:13.721896 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:13.722318 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:13.860169 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:13.869055 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bc91c439-6666-42a9-8a39-70a524528b43 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.159845 Sep 01 16:54:13.869247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 694/1407] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:13 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:14.890978 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:14.891717 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:14.898226 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:14.898712 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:14.899143 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:14.899866 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:14.900311 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:14.900727 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:15.041671 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:15.043417 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-45c55643-8acf-45c5-9feb-ac626a053a02 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.157058 Sep 01 16:54:15.044004 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 714/1408] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:14 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:16.064849 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:16.065436 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:16.072319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:16.078941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:16.078941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:16.078941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:16.078941 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:16.079385 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:16.216226 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:16.225586 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1c2a0537-ea2b-4db0-ac7e-25d6373314b0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1265 microversion: 2.1 time: 0.164709 Sep 01 16:54:16.226170 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 695/1409] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:16 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:17.246380 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:17.247465 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:17.253610 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:17.254120 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:17.254704 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:17.255434 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:17.255893 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:17.256440 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:17.405857 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:17.414485 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-88c4725d-4add-46c4-af2c-bb5c12c63316 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1451 microversion: 2.1 time: 0.172038 Sep 01 16:54:17.415066 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 715/1410] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:17 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:17.435656 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:17.436271 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:17.442919 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:17.443435 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:17.443863 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:17.444555 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:17.445007 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:17.445425 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:17.605424 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:17.614023 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f2b9204a-cc73-4dfe-8325-e45e4f8babb0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1451 microversion: 2.1 time: 0.181958 Sep 01 16:54:17.614612 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 696/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:17 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:20.071733 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-d201c399-a65b-4b72-a52b-e879b065c0b9 req-fb45dac7-0a53-4e3b-b40a-d076a2886a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3a781b-0f93-4d38-baa2-fc8ba8989f87", "tag": "3107aaf2-29b9-4f69-8d3e-44b9f94253a5"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:54:20.082969 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-d201c399-a65b-4b72-a52b-e879b065c0b9 req-fb45dac7-0a53-4e3b-b40a-d076a2886a95 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:20.083267 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-d201c399-a65b-4b72-a52b-e879b065c0b9 req-fb45dac7-0a53-4e3b-b40a-d076a2886a95 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:20.083653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-d201c399-a65b-4b72-a52b-e879b065c0b9 req-fb45dac7-0a53-4e3b-b40a-d076a2886a95 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:20.095090 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-d201c399-a65b-4b72-a52b-e879b065c0b9 req-fb45dac7-0a53-4e3b-b40a-d076a2886a95 service nova] Creating event network-changed:3107aaf2-29b9-4f69-8d3e-44b9f94253a5 for instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 on hv-cinder-83602 Sep 01 16:54:20.101652 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-d201c399-a65b-4b72-a52b-e879b065c0b9 req-fb45dac7-0a53-4e3b-b40a-d076a2886a95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033778 Sep 01 16:54:20.102221 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 716/1412] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:56:20.938221 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=24 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:20.939539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=56 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:20.944969 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:20.945467 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:20.946028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e318b56-7599-44d6-acfe-e194cd1b62d2] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 16:56:20.946778 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:20.947690 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG dbcounter [-] [127532] Writing DB stats nova_cell1:SELECT=60 {{(pid=127532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:56:20.952699 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:20.953194 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:20.953633 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:20.953975 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [req-9c20d456-ae42-4f21-932f-8572dd24fccd req-62019204-c1b8-4e05-9d11-bdfe22a0430e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3a781b-0f93-4d38-baa2-fc8ba8989f87", "tag": "3107aaf2-29b9-4f69-8d3e-44b9f94253a5"}]} {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:56:20.954344 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:20.954797 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:20.955247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:20.967263 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-9c20d456-ae42-4f21-932f-8572dd24fccd req-62019204-c1b8-4e05-9d11-bdfe22a0430e service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:20.970606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-9c20d456-ae42-4f21-932f-8572dd24fccd req-62019204-c1b8-4e05-9d11-bdfe22a0430e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:20.970606 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [req-9c20d456-ae42-4f21-932f-8572dd24fccd req-62019204-c1b8-4e05-9d11-bdfe22a0430e service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:20.980388 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.compute.server_external_events [req-9c20d456-ae42-4f21-932f-8572dd24fccd req-62019204-c1b8-4e05-9d11-bdfe22a0430e service nova] Creating event network-changed:3107aaf2-29b9-4f69-8d3e-44b9f94253a5 for instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 on hv-cinder-83602 Sep 01 16:56:20.986463 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:56:20.987967 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [req-9c20d456-ae42-4f21-932f-8572dd24fccd req-62019204-c1b8-4e05-9d11-bdfe22a0430e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045409 Sep 01 16:56:20.987967 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 717/1413] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:56:21.257412 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c0b9ff69-0963-4bbe-866a-657a62f93bd4 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 204 len: 0 microversion: 2.1 time: 0.320024 Sep 01 16:56:21.258584 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 697/1414] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:56:20 2022] DELETE /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:56:21.268584 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:21.269398 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:21.276885 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:21.277497 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:21.278028 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:21.279334 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:21.280374 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:21.280374 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:21.426636 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:21.434952 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-88023f53-f1eb-4f8f-b339-bfee8a9c69d5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1576 microversion: 2.1 time: 0.170619 Sep 01 16:56:21.440069 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 718/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:21 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:22.456957 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:22.457606 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:22.464113 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:22.464590 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:22.465017 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:22.466203 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:22.466659 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:22.467300 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:22.676701 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:22.685440 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5a915f8e-ed95-4e78-9193-6cfaedcd26dd tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1576 microversion: 2.1 time: 0.232245 Sep 01 16:56:22.686027 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 698/1416] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:22 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:23.708064 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:23.709126 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:23.719469 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:23.719957 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:23.720395 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:23.721106 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:23.721561 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:23.721981 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:23.742511 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e318b56-7599-44d6-acfe-e194cd1b62d2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54394. Sep 01 16:56:23.864818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:23.872788 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-6e6ad186-bebc-4b62-825e-918c85af9a5d tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1457 microversion: 2.1 time: 0.168556 Sep 01 16:56:23.873364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 719/1417] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:23 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1457 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:24.054893 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-26714f53-2ef9-4e91-8af1-06c3002359e0 req-2f25a4c8-a588-4e09-bdf9-0f13bcd23d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3a781b-0f93-4d38-baa2-fc8ba8989f87", "name": "network-vif-deleted", "tag": "3107aaf2-29b9-4f69-8d3e-44b9f94253a5"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:56:24.064948 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-26714f53-2ef9-4e91-8af1-06c3002359e0 req-2f25a4c8-a588-4e09-bdf9-0f13bcd23d6a service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:24.065431 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-26714f53-2ef9-4e91-8af1-06c3002359e0 req-2f25a4c8-a588-4e09-bdf9-0f13bcd23d6a service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:24.065866 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-26714f53-2ef9-4e91-8af1-06c3002359e0 req-2f25a4c8-a588-4e09-bdf9-0f13bcd23d6a service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:24.083610 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-26714f53-2ef9-4e91-8af1-06c3002359e0 req-2f25a4c8-a588-4e09-bdf9-0f13bcd23d6a service nova] Creating event network-vif-deleted:3107aaf2-29b9-4f69-8d3e-44b9f94253a5 for instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 on hv-cinder-83602 Sep 01 16:56:24.088476 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-26714f53-2ef9-4e91-8af1-06c3002359e0 req-2f25a4c8-a588-4e09-bdf9-0f13bcd23d6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093639 Sep 01 16:56:24.089083 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 699/1418] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:56:24.903049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:24.903049 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:24.906493 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:24.906967 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:24.907421 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:24.908112 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:24.908559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:24.908974 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:24.942852 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:24.943375 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:24.943834 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:24.944275 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.objects.instance [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lazy-loading 'fault' on Instance uuid 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 {{(pid=127532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:56:24.984908 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:24.992524 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ace219fd-03f4-4ffb-a0a0-f91ef4796070 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 200 len: 1230 microversion: 2.1 time: 0.097449 Sep 01 16:56:24.993094 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 720/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:24 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:26.014520 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:26.015247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: 8e3a781b-0f93-4d38-baa2-fc8ba8989f87] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:26.021416 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:26.021890 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:26.022319 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:26.022998 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:26.023489 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:26.023906 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:26.036925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] HTTP exception thrown: Instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 could not be found. Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Request method failure captured: Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 HTTP/1.1 Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEOIkNa_UJ-shqJgdO_mhVfVL2mMtYWkXWMFe5z8L15bpBW4l9t8QgT--Sai96g8Imv85MEDk_yoguW2c0vsGAhRA3PRerSvRvEHoAwN1SjigwRQ_cwnxMwoUgKdgA38mg6-zKQoE1G2s2E-GcTub1i2Hnd6Kte-kkV_xyVteM034Oqo Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:56:26.038557 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38f1672c9b5147fe8fef8659e7953fef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: ec2aa8d7d4474e5b802c91c4cb5958cd Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 could not be found. Sep 01 16:56:26.040530 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': '8e3a781b-0f93-4d38-baa2-fc8ba8989f87'} Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 could not be found. Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:56:26.042409 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 could not be found. Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 could not be found. Sep 01 16:56:26.046067 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:26.048243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Returning 404 to user: Instance 8e3a781b-0f93-4d38-baa2-fc8ba8989f87 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:56:26.048243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-85a8987d-2149-4e41-a887-1b29cc36f0ac tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87" status: 404 len: 111 microversion: 2.1 time: 0.030103 Sep 01 16:56:26.048243 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 700/1420] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:26 2022] GET /compute/v2.1/servers/8e3a781b-0f93-4d38-baa2-fc8ba8989f87 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:29.728828 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:29.729413 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:29.730546 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-50a014b0-6103-4139-aa53-395a4a069343 req-9a7e4f4a-6615-4fa3-96fd-c2b461972a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a2def2-f049-4737-9e7e-53a62ac71fe7", "tag": "1cbdb3ea-9cba-44b9-a5a5-1633d5881c69"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:56:29.738627 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:29.739119 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:29.739583 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:29.740672 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:29.741233 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-50a014b0-6103-4139-aa53-395a4a069343 req-9a7e4f4a-6615-4fa3-96fd-c2b461972a64 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:29.741931 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-50a014b0-6103-4139-aa53-395a4a069343 req-9a7e4f4a-6615-4fa3-96fd-c2b461972a64 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:29.742752 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-50a014b0-6103-4139-aa53-395a4a069343 req-9a7e4f4a-6615-4fa3-96fd-c2b461972a64 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:29.745745 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:29.746329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:29.755533 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-50a014b0-6103-4139-aa53-395a4a069343 req-9a7e4f4a-6615-4fa3-96fd-c2b461972a64 service nova] Creating event network-changed:1cbdb3ea-9cba-44b9-a5a5-1633d5881c69 for instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 on hv-cinder-83602 Sep 01 16:56:29.762228 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-50a014b0-6103-4139-aa53-395a4a069343 req-9a7e4f4a-6615-4fa3-96fd-c2b461972a64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035447 Sep 01 16:56:29.763648 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 701/1421] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:56:29.775329 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Going to try to terminate instance {{(pid=127532) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:56:30.068122 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-7c7703a5-ab84-4304-ad6d-f031e48b9ed5 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 204 len: 0 microversion: 2.1 time: 0.343375 Sep 01 16:56:30.069024 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 721/1422] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:56:29 2022] DELETE /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:56:30.078084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:30.078937 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:30.086353 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:30.087248 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:30.089191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:30.089191 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:30.089637 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:30.090247 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:30.417143 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:30.426696 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bf11aafc-465d-4eaf-a82e-6370c6ea06e0 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1577 microversion: 2.1 time: 0.353040 Sep 01 16:56:30.427305 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 702/1423] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:30 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1577 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:31.449378 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:31.450193 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:31.456860 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:31.457337 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:31.457770 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:31.458477 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:31.458927 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:31.460132 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:31.595944 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:31.603799 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-e93359dd-91ef-4d1c-90b9-14ab1dda23d7 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1458 microversion: 2.1 time: 0.158665 Sep 01 16:56:31.604370 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 722/1424] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:31 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:32.166759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-60b9152d-0533-4ecb-950c-df9e61be7231 req-7887fbf7-0390-4759-918f-8b66e7990987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a2def2-f049-4737-9e7e-53a62ac71fe7", "name": "network-vif-deleted", "tag": "1cbdb3ea-9cba-44b9-a5a5-1633d5881c69"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:56:32.178075 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-60b9152d-0533-4ecb-950c-df9e61be7231 req-7887fbf7-0390-4759-918f-8b66e7990987 service nova] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:32.178556 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-60b9152d-0533-4ecb-950c-df9e61be7231 req-7887fbf7-0390-4759-918f-8b66e7990987 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:32.178989 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-60b9152d-0533-4ecb-950c-df9e61be7231 req-7887fbf7-0390-4759-918f-8b66e7990987 service nova] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:32.190501 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-60b9152d-0533-4ecb-950c-df9e61be7231 req-7887fbf7-0390-4759-918f-8b66e7990987 service nova] Creating event network-vif-deleted:1cbdb3ea-9cba-44b9-a5a5-1633d5881c69 for instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 on hv-cinder-83602 Sep 01 16:56:32.195432 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-60b9152d-0533-4ecb-950c-df9e61be7231 req-7887fbf7-0390-4759-918f-8b66e7990987 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032350 Sep 01 16:56:32.196014 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 703/1425] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 16:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:56:32.624767 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:32.625327 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:32.631754 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:32.632234 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:32.632667 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:32.633364 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:32.633809 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:32.634228 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:32.701693 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.policy [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127532) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:32.709426 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-ee42511b-11ba-4dd5-87d1-91e97a745368 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1225 microversion: 2.1 time: 0.088616 Sep 01 16:56:32.710082 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 723/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:32 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:33.730759 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:33.739335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:33.739335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:33.739335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:33.739335 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:33.740099 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:33.740583 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:33.741008 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:33.770769 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:33.771278 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:33.771714 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:33.772153 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lazy-loading 'fault' on Instance uuid f1a2def2-f049-4737-9e7e-53a62ac71fe7 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:56:33.817024 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2aa8d7d4474e5b802c91c4cb5958cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f1672c9b5147fe8fef8659e7953fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:33.824676 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-87a106d0-e263-4f4f-9ea2-dff643cab75a tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 200 len: 1230 microversion: 2.1 time: 0.098608 Sep 01 16:56:33.825240 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 704/1427] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:33 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:34.847139 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:34.847714 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: f1a2def2-f049-4737-9e7e-53a62ac71fe7] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:34.854062 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:34.854537 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:34.854968 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:34.855689 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:34.856140 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:34.856559 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:34.870388 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] HTTP exception thrown: Instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 could not be found. Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Request method failure captured: Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 HTTP/1.1 Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEOIkNa_UJ-shqJgdO_mhVfVL2mMtYWkXWMFe5z8L15bpBW4l9t8QgT--Sai96g8Imv85MEDk_yoguW2c0vsGAhRA3PRerSvRvEHoAwN1SjigwRQ_cwnxMwoUgKdgA38mg6-zKQoE1G2s2E-GcTub1i2Hnd6Kte-kkV_xyVteM034Oqo Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:56:34.872048 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38f1672c9b5147fe8fef8659e7953fef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: ec2aa8d7d4474e5b802c91c4cb5958cd Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 could not be found. Sep 01 16:56:34.873783 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'f1a2def2-f049-4737-9e7e-53a62ac71fe7'} Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 could not be found. Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:56:34.874786 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 could not be found. Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 could not be found. Sep 01 16:56:34.877210 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:34.878669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Returning 404 to user: Instance f1a2def2-f049-4737-9e7e-53a62ac71fe7 could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:56:34.878669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-b42eca7c-15ff-4cc3-9bfb-d6cff3b9d47c tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7" status: 404 len: 111 microversion: 2.1 time: 0.030256 Sep 01 16:56:34.878669 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 724/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:34 2022] GET /compute/v2.1/servers/f1a2def2-f049-4737-9e7e-53a62ac71fe7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:35.383336 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:35.383893 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:35.390340 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:35.390934 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:35.391386 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:35.392063 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:35.392509 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:35.392925 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:35.405874 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] HTTP exception thrown: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Request method failure captured: Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea HTTP/1.1 Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Connection: close Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Host: 10.222.0.16 Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEOIkNa_UJ-shqJgdO_mhVfVL2mMtYWkXWMFe5z8L15bpBW4l9t8QgT--Sai96g8Imv85MEDk_yoguW2c0vsGAhRA3PRerSvRvEHoAwN1SjigwRQ_cwnxMwoUgKdgA38mg6-zKQoE1G2s2E-GcTub1i2Hnd6Kte-kkV_xyVteM034Oqo Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 01 16:56:35.408257 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38f1672c9b5147fe8fef8659e7953fef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Id: ec2aa8d7d4474e5b802c91c4cb5958cd Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: method: > Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: exception: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.410096 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: action_args: {'id': 'd90c2d5b-e878-487e-a113-7dcdaca36dea'} Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:56:35.411084 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.412816 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.414539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Returning 404 to user: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:56:35.414539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3888f42-231b-48e8-9a18-24e3ae0fdeb1 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 404 len: 111 microversion: 2.1 time: 0.030349 Sep 01 16:56:35.414539 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 705/1429] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 16:56:35 2022] DELETE /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:35.418165 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '>' {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:35.418771 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.compute.api [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] [instance: d90c2d5b-e878-487e-a113-7dcdaca36dea] Fetching instance by UUID {{(pid=127532) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:35.425653 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:35.426137 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:35.426574 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:35.427307 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Acquiring lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:35.427766 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:35.428192 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG oslo_concurrency.lockutils [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Lock "82d7d12e-bed5-49fc-8bd1-b3172eaca82c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:35.442281 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.wsgi [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] HTTP exception thrown: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Request method failure captured: Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: request: GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea HTTP/1.1 Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept: application/json Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Accept-Encoding: identity Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Connection: close Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Length: 0 Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Content-Type: application/json Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Host: 10.222.0.16 Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: Openstack-System-Scope: None Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: User-Agent: python-urllib3/1.26.12 Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Auth-Token: gAAAAABjEOIkNa_UJ-shqJgdO_mhVfVL2mMtYWkXWMFe5z8L15bpBW4l9t8QgT--Sai96g8Imv85MEDk_yoguW2c0vsGAhRA3PRerSvRvEHoAwN1SjigwRQ_cwnxMwoUgKdgA38mg6-zKQoE1G2s2E-GcTub1i2Hnd6Kte-kkV_xyVteM034Oqo Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Id: None Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Domain-Name: None Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Identity-Status: Confirmed Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Is-Admin-Project: True Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Id: default Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Domain-Name: Default Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Project-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Role: reader,member Sep 01 16:56:35.443818 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Roles: reader,member Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38f1672c9b5147fe8fef8659e7953fef", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38f1672c9b5147fe8fef8659e7953fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Id: 38f1672c9b5147fe8fef8659e7953fef Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-Tenant-Name: tempest-TestVolumeBootPattern-1443156573 Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Id: default Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Domain-Name: Default Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Id: ec2aa8d7d4474e5b802c91c4cb5958cd Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: X-User-Name: tempest-TestVolumeBootPattern-1443156573-project Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: method: > Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: exception: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.445456 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: action_args: {'id': 'd90c2d5b-e878-487e-a113-7dcdaca36dea'} Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: {{(pid=127532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:56:35.446387 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. Sep 01 16:56:35.447800 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: ERROR nova.api.openstack.wsgi Sep 01 16:56:35.449013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: DEBUG nova.api.openstack.wsgi [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Returning 404 to user: Instance d90c2d5b-e878-487e-a113-7dcdaca36dea could not be found. {{(pid=127532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:56:35.449013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: INFO nova.api.openstack.requestlog [None req-8214827d-11b0-4c84-a16c-3e2dfb6a8830 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea" status: 404 len: 111 microversion: 2.1 time: 0.030761 Sep 01 16:56:35.449013 dv-cinder-836027-9-iscsi devstack@n-api.service[127532]: [pid: 127532|app: 0|req: 725/1430] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:35 2022] GET /compute/v2.1/servers/d90c2d5b-e878-487e-a113-7dcdaca36dea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:36.930123 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4d793b8f-31e8-428f-b44d-0fcad0b3c533 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] Calling method '.version_select at 0x7fe37ae7bee0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:36.994231 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4d793b8f-31e8-428f-b44d-0fcad0b3c533 tempest-TestVolumeBootPattern-1443156573 tempest-TestVolumeBootPattern-1443156573-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-306489743" status: 202 len: 0 microversion: 2.1 time: 0.067938 Sep 01 16:56:36.994853 dv-cinder-836027-9-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 706/1431] 10.222.0.16 () {58 vars in 1260 bytes} [Thu Sep 1 16:56:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-306489743 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)